-- Logs begin at Sat 2022-01-15 14:58:06 UTC, end at Sat 2022-01-15 16:34:38 UTC. -- Jan 15 15:39:34.171304 dv-cinder-824819-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 15 15:39:34.180745 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 15 15:39:34 2022] *** Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: nodename: dv-cinder-824819-1-iscsi Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: machine: x86_64 Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: clock source: unix Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: pcre jit disabled Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: detected number of CPU cores: 4 Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: current working directory: / Jan 15 15:39:34.182650 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: detected binary path: /usr/bin/uwsgi-core Jan 15 15:39:34.183295 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: your processes number limit is 47680 Jan 15 15:39:34.183295 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: your memory page size is 4096 bytes Jan 15 15:39:34.183295 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: detected max file descriptor number: 2048 Jan 15 15:39:34.183295 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: lock engine: pthread robust mutexes Jan 15 15:39:34.183295 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: thunder lock: enabled Jan 15 15:39:34.183295 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 15 15:39:34.183295 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 15 15:39:34.228494 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: Python main interpreter initialized at 0x5589f9e5f9c0 Jan 15 15:39:34.228494 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: python threads support enabled Jan 15 15:39:34.228494 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: your server socket listen backlog is limited to 100 connections Jan 15 15:39:34.228494 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: your mercy for graceful operations on workers is 90 seconds Jan 15 15:39:34.228881 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: mapped 403077 bytes (393 KB) for 2 cores Jan 15 15:39:34.228881 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: *** Operational MODE: preforking *** Jan 15 15:39:34.229147 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: *** uWSGI is running in multiple interpreter mode *** Jan 15 15:39:34.229147 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: spawned uWSGI master process (pid: 108763) Jan 15 15:39:34.229354 dv-cinder-824819-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 15 15:39:34.230361 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: spawned uWSGI worker 1 (pid: 108764, cores: 1) Jan 15 15:39:34.233347 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: spawned uWSGI worker 2 (pid: 108765, cores: 1) Jan 15 15:39:34.233347 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 15 15:39:36.084966 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:39:36.084966 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: from cryptography.utils import int_from_bytes Jan 15 15:39:36.085613 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:39:36.085613 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: from cryptography.utils import int_from_bytes Jan 15 15:39:36.205785 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:39:36.205785 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: from cryptography.utils import int_from_bytes Jan 15 15:39:36.206482 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:39:36.206482 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: from cryptography.utils import int_from_bytes Jan 15 15:39:38.671531 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 15:39:38.672057 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 15:39:38.672306 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 15:39:38.672666 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 15:39:38.672921 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 15:39:38.673307 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.673633 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.673956 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.674276 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.674603 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.674912 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.675234 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.675553 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.675882 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.676160 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.676479 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.676803 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824819-1-iscsi {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.677123 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.677432 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.677742 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.678061 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.678365 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.678688 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.679002 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.679495 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.681183 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.681183 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.681183 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.681535 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.681831 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.682167 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.682472 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.682782 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.683103 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.683414 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.683812 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824819-1-iscsi {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.684131 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.684471 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.684790 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.685204 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.685518 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.685829 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.686151 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.686475 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.686785 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.687388 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.687709 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.688030 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.688375 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.688680 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.688875 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 15:39:38.689252 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.689339 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 15:39:38.689417 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.689596 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.689681 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 15:39:38.689902 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.689999 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 15:39:38.690197 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 15:39:38.690302 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.690442 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.690579 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.690751 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.690885 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.691067 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.691194 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.691424 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.691557 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.691710 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.691840 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.691963 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.692113 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.692266 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.692460 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.692594 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.692778 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.692911 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.693107 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.693234 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.693365 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.693487 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.693668 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.693794 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.694001 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824819-1-iscsi {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.694131 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.694297 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.694425 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.694602 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.694741 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.694908 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.695036 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.695215 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.695340 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.696068 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.696256 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.696488 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.696698 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.696905 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.697060 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.697226 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.697551 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.697676 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.697865 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.697990 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.698172 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.698308 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.698483 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.698610 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.698822 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.698947 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.699135 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.699268 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.699443 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.699571 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.699762 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.699886 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.700068 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.700240 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.700416 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.700549 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.700722 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.700847 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.701032 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.701158 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824819-1-iscsi {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.701353 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.701498 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.701688 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.701823 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.701995 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.702121 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.702285 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.702408 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.702543 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.702707 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.702833 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.703015 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.703140 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.703335 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.703471 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.703666 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.703793 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.703972 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.704098 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.704324 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.704470 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.704630 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.704755 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.704941 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.705073 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.705247 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.705381 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.705546 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.705671 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.705851 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.705976 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.706156 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.706286 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.706461 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.706589 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.706769 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.706893 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.707072 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.707199 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.707319 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.707439 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.707611 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.707744 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.707931 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.708058 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.708284 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.708421 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.708598 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.708731 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.708857 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.708979 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.709121 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.709253 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.709383 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.709517 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.709686 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.709814 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.709993 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.710128 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.710299 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.710433 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.710605 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.710730 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.710910 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.711035 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.711348 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.711872 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.711872 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.712112 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.712302 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.712433 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.712565 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.712694 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.712817 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.712938 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713069 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713216 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713349 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713472 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713601 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713731 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713862 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.713990 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.714121 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.714244 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.714371 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.714500 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.714632 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.714755 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.714940 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.715078 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.715246 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.715395 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.715549 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.715705 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.715868 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.716024 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.716213 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.716374 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.716511 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.716681 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.716808 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.716986 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.717113 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.717305 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.717446 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.717604 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.717731 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.717934 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.718070 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.718237 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.718391 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.718526 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.718708 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.718835 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.719041 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.719169 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.719363 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.719489 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.719670 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.719802 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.719976 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.720101 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.720309 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.720437 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.720610 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.720735 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.720915 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.721070 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.721202 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.721333 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.721510 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.721637 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.721817 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.721943 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.722141 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.722272 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.722394 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.722522 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.722708 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.722843 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.723014 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.723141 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.723317 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.723442 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.723634 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.723769 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.723954 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.724080 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.724284 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.724412 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.724590 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.724729 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.724895 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.725031 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.725201 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.725336 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.725569 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.725725 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.725883 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.726034 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.726211 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.726344 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.726522 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.726661 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.727392 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.727559 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.727701 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.728010 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.728183 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.728349 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.728477 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.728690 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.728836 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.728996 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.729130 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.729310 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.729440 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.729626 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.729751 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.729937 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.730072 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.730253 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.730377 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.730562 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.730693 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.730866 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.730999 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.731383 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.731536 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.731536 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.731820 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.731957 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.732098 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.732250 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.732374 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.732498 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.732687 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.732817 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.733016 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.733148 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.733338 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.733465 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.733674 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.733811 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.733996 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.734131 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.734304 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.734619 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.734931 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.735238 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.735563 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.735874 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.736007 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.736213 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.736368 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.736540 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.736693 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.736848 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.737030 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:39:38.737158 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.737380 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.737526 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.737722 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.737843 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.738050 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.738176 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.738360 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.738498 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.738682 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.738811 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.738994 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.739130 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.739305 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.739436 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.739639 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.739767 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.739967 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.740094 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.740295 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.740428 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.740604 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.740733 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.740928 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.741057 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.741243 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.741370 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.741547 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.741681 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.741859 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.741980 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.742167 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.742296 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.743073 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.743205 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.743389 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.743580 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.743713 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.743846 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.743994 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.744123 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.744326 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.744473 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.744632 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.744762 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.744936 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.745073 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.745241 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.745380 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.745566 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.745696 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.745876 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.746004 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.746181 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.746388 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.746515 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.746646 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.746772 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.746896 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.747108 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.747237 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.747416 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.747544 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.747758 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.747887 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.748095 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.748275 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.748437 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.748566 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.748763 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.748894 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.749075 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.749202 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.749390 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.749517 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.749701 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.749829 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.750013 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.750143 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.750321 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.750447 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.750630 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.750770 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.750935 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.751064 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.751247 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.751382 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.751563 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.751700 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.751873 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.752003 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.752221 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.752365 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.752534 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.752673 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.752854 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.752990 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.753165 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.753307 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.753480 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.753617 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.753793 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.753920 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.754139 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.754265 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.754454 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.754595 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.754776 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.755002 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.755131 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.755388 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.755528 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.755697 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.755880 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.756008 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.756328 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.756472 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.756638 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.756819 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.756947 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.757254 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.757381 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.757571 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.757748 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.757883 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.758222 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.758406 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.758667 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.758796 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.758996 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.759124 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.759302 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.759600 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.759848 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.759988 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.760120 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.760293 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.760482 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.760611 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.760803 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.760940 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.761120 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.761260 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.761461 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.761598 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.761773 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.761912 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.762085 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.762206 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.762391 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.762519 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.762696 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.762832 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.763006 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.763134 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.763325 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.763453 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.763635 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.763770 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.763942 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.764061 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.764269 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.764400 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.764584 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.764722 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.764892 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.765136 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.765263 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.765487 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.765625 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.765799 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.766018 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.766153 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.766419 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.766545 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.766741 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.766950 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.767078 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.767353 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.767478 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.767656 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.767786 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.767980 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.768258 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.768399 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.768607 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.768743 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.768910 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.769179 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.769315 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.769544 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.769672 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.769851 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.769988 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.770156 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.770290 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.770474 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.770632 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.770794 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.770968 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.771097 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.771289 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.771416 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.771613 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.771748 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.771926 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.772061 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.772274 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.772401 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.772571 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.772707 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.772884 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.773012 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.773196 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.773331 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.773508 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.773659 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.773954 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.774082 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.774267 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.774393 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.774591 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.774720 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.774902 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.775029 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.775215 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.775351 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.775527 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.775663 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.775831 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.776035 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.776183 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.776466 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.776593 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.776923 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.777050 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.777364 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.777489 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.777688 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.777921 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.778041 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.778297 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.778431 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.778615 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.778753 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.778949 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.779085 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.779279 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.779410 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.779595 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.779724 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.779904 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.780039 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.780238 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.780370 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.780544 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.780673 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.780849 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.780977 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.781158 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.781286 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.781464 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.781594 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.781770 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.781898 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.782074 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.782202 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.782383 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.782512 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.782686 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.782814 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.782991 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.783202 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.783342 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.783629 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.783765 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.783944 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.784113 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.784259 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.784575 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.784714 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.784879 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.785122 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.785250 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.785498 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.785624 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.785803 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.786002 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.786130 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.786395 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.786529 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.786736 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.786888 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.787042 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.787363 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.787490 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.787692 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.787855 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.788033 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.788222 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.788366 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.788539 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.788667 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.788857 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.788987 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.789167 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.789802 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.790102 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.790238 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.790407 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.790608 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.790749 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.790883 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.791008 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.791198 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.791327 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.791508 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.791636 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.791815 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.791947 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.792131 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.792277 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.792486 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.792613 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.792797 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.792924 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.793106 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.793243 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.793408 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.793536 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.793716 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.793843 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.794021 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.794156 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.794323 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.794452 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.794627 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.794763 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.794929 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.795056 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.795230 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.795358 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.795529 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.795665 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.795837 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.795966 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.796187 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.796319 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.796474 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.796616 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.796778 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.796914 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.797081 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.797209 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.797384 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.797513 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.797694 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.797820 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.798000 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.798138 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.798302 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.798431 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.798617 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.798743 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.798927 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.799052 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.799231 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.799360 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.799534 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.799669 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.799840 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.799967 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.800158 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.800290 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.800462 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.800601 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.800770 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.800898 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.801092 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.801228 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.801406 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.801550 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.801706 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.801845 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.802015 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.802151 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.802318 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.802447 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.802622 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.802759 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.802925 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.803181 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.803316 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.803517 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.803653 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.803821 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.803949 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.804122 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.804273 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.804442 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.804571 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.804743 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.805470 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.805667 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.805797 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.806075 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.806245 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.806385 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.806511 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.806689 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.806811 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.806994 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.807132 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.807310 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.807445 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.807618 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.807747 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.807930 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.808071 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.808259 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.808402 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.808567 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.808696 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.808872 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.809008 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.809181 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.809309 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.809485 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.809612 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.809790 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.809919 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.810091 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.810217 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.810405 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.810534 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.810716 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.810858 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.811017 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.811144 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.811316 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.811442 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.811618 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.811756 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.811938 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.812351 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.812532 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.812669 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.812837 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.812973 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.813140 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.813268 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.813444 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.813578 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.813779 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.813919 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.814083 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.814217 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.814390 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.814518 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.814701 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.814830 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.815008 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.815136 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.815315 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.815442 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.815623 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.815759 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.815932 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.816068 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.816264 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.816393 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.816569 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.816697 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.816872 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.817001 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.817180 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.817306 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.817486 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.817615 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.817786 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.817913 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.818092 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.818227 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.818395 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.818522 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.818703 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.818830 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.819011 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.819149 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.819313 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.819448 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.819621 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.819747 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.819923 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.820059 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.820256 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.820386 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.820631 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.821028 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.821233 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.821373 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.821556 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.821685 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.821873 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.822008 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.822186 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.822316 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.822503 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.822631 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.822818 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.822953 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.823137 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.823267 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.823456 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.823584 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.823761 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.823895 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.824069 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.824216 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.824402 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.824532 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.824713 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.824842 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.825025 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.825162 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.825332 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.825462 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.825658 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.825803 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.825970 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.826103 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.826276 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.826405 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.826579 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.826722 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.826882 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.827001 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.827182 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.827308 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.827486 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.827624 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.827795 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.827924 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.828115 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.828262 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.828452 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.828596 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.828756 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.828883 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.829063 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.829191 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.829363 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.829553 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.829682 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.829868 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.829996 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.830181 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.830317 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.830503 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.830634 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.830817 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.830944 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.831117 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.831255 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.831417 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.831545 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.831717 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.831845 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.832028 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.832293 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.832422 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.832545 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.832722 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.832851 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.833025 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.833161 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.833325 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.833454 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.833644 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.833771 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.833955 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.834083 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.834278 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.834404 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.834589 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.834717 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.834909 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.835045 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.835295 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.835422 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.835611 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.835739 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.835920 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.836078 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.836359 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.836487 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.836668 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.836883 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.837030 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.837164 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.837290 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.837417 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.837581 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.837719 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.837885 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.838015 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.838189 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.838317 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.838511 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.838643 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.838818 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.838943 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.839124 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.839252 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.839433 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.839569 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.839744 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.839873 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.840048 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.840227 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.840376 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.840517 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.840681 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.840837 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.840991 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.841121 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.841298 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.841436 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.841605 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.841734 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.841911 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.842039 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.842224 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.842361 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.842527 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.842654 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.842836 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.842963 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.843146 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.843276 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.843449 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.843583 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.843752 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.843878 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.844060 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.844216 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.844399 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.844527 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.844702 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.844840 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.845024 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.845158 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.845332 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.845460 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.845634 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.845924 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846073 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846200 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846324 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846448 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846573 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846705 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846830 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.846969 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.847207 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.847334 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.847529 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.847657 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.847831 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.847958 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.848174 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.848304 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.848467 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.848658 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.848800 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.848934 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.849059 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.849182 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.849364 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.849494 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.849671 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.849799 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.849972 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.850111 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.850277 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.850406 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.850579 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.850720 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.850900 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.851029 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.851202 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.851331 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.851537 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.851666 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.852411 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.852555 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.852684 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.852809 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.852947 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.853158 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.853289 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.853464 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.853594 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.853769 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.853908 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.854092 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.854222 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.854396 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.854525 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.854716 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.854848 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.855125 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.855253 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.855433 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.855561 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.855737 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.855875 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.856057 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.856202 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.856399 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.856554 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.856717 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.856848 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.857033 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.857170 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.857349 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.857487 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.857662 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.857792 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.857975 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.858104 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.858284 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.858421 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.858590 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.858718 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.858904 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.859032 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.859220 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.859420 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.859546 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.859740 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.859896 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.860068 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.860243 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.860408 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.860550 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.860722 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.860860 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.861034 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.861173 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.861349 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.861486 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.861663 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.861791 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.861975 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.862115 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.862286 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.862416 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.862597 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.862726 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.862907 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.863049 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.863235 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.863363 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.863553 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.863680 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.863864 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.864001 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.864186 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.864321 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.864496 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.864635 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.864819 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.864949 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.865121 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.865252 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.865430 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.865558 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.865739 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.865868 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.866045 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.866180 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.866348 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.866485 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.866650 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.866782 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.866970 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.867098 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.867275 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.868002 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.868540 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.868895 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.869024 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.869223 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.869361 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.869545 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.869676 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.869867 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.869997 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.870184 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.870326 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.870499 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.870629 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.870802 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.870930 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.871109 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.871247 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.871413 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.871544 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.871756 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.871896 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.872062 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.872243 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.872405 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.872533 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.872717 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.872857 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.873037 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.873175 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.873345 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.873558 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.873687 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.873872 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.874015 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.874207 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.874336 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.874534 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.874664 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.874861 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.875000 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.875185 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.875315 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.875486 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.875620 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.875796 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.875934 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.876099 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.876271 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.876428 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.876558 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.876731 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.876855 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.877038 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.877178 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.877337 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.877464 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.877639 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.877769 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.877940 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.878074 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.878246 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.878373 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.878550 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.878677 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.878861 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.878989 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.879167 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.879395 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.879532 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.879746 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.879875 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.880043 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.880192 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.880400 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.880530 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.880701 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.880828 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.881032 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.881161 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.881337 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.881466 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.881658 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.881785 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.881965 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.882094 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.882274 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.882404 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.882589 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.882718 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.882902 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.883082 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.883304 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.883435 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.883627 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.883757 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.883943 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.884085 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.884280 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.884411 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.884597 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.884726 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.884912 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.885052 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.885219 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.885349 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.885533 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.885670 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.885842 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.885978 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.886151 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.886287 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.886456 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.886669 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.886798 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.886999 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.887129 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.887316 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.887446 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.887630 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.887773 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.887944 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.888073 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.888280 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.888409 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.888586 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.888725 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.888896 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.889026 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.889203 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.889340 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.889515 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.889719 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.889847 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.889970 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.890103 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.890229 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.890408 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.890547 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.890733 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.890870 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.891037 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.891166 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.891344 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.891475 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.891664 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.891801 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.891979 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.892108 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.892315 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.892445 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.892636 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.892763 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.892953 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.893091 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.893270 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.893409 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.893586 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.893715 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.893900 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.894132 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.894263 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.894512 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.894645 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.894823 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.894961 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.895139 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.895269 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.895455 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.895620 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.895749 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.895873 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.896062 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.896208 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.896403 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.896543 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.896717 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.896856 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.897040 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.897177 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.897375 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.897504 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.897695 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.897825 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.898011 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.898140 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.898322 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.898450 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.898748 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.898890 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.899122 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.899290 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.899424 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.899605 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.899742 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.899938 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.900067 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.900313 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.900444 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.900639 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.900781 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.900957 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.901087 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.901275 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.901406 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.901598 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.901736 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.901904 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.902034 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.902208 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.902337 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.902517 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.902661 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.902821 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.902949 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.903124 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.903265 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.903449 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.903579 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.903756 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.903892 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.904058 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.904203 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.904406 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.904537 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.904717 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.904851 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.905112 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.905241 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.905435 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.905565 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.905749 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.905878 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.906073 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.906219 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.906396 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.906526 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.906709 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.906838 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.907032 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.907171 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.907347 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.907482 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.907677 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.907806 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.907995 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.908131 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.908334 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.908465 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.908647 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.908776 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.908952 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.909091 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.909257 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.909387 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.909562 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.909700 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.909868 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.910004 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.910170 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.910299 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.910478 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.910607 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.910782 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.910919 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.911107 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.911237 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.911411 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.911548 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.911715 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.911845 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.912018 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.912169 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.912355 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.912501 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.912661 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.912790 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.912964 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.913102 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.913273 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.913409 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.913573 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.913702 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.913887 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.914016 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.914685 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.914851 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.915004 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.915138 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.915311 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.915439 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.915621 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.915759 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.915924 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.916054 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.916255 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.916386 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.916560 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.916691 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.916882 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.917011 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.917186 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.917315 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.917489 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.917619 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.917802 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.917932 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.918110 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.918247 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.918432 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.918562 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.918744 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.918873 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.919056 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.919185 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.919386 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.919511 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.919707 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.919836 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.920019 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.920257 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.920390 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.920637 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.920767 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.920959 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.921088 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.921290 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.921419 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.921662 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.921799 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.921925 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.922048 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.922216 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.922377 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.922505 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.922630 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.922830 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.922970 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.923141 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.923271 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.923451 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.923579 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.923766 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.923904 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.924075 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.924241 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.924377 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 15:39:38.924503 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.924706 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.925015 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.925322 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.925629 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.925941 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.926278 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.926595 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.926912 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.927225 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.927540 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.927847 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.928174 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.928485 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.928792 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.929105 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.929432 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.929744 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.930097 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.930508 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.930817 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.931135 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.931456 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.931764 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.932082 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.932436 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.932747 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.933066 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.933374 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.933706 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.934041 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.934365 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.934686 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.934989 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.935291 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.935593 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.935996 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.936357 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.936687 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.937249 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.937572 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.937882 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.938201 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.938509 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.938827 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.939145 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.939460 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.939767 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.940094 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.940427 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.940740 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.941051 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.941360 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.941669 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.942081 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.942397 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.942728 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.943034 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.943358 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.943681 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.944018 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.944349 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.944647 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.944977 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.945290 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.946136 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.946447 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.946758 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.947085 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.947391 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.947713 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.948036 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.948213 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_db.sqlalchemy.engines [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:38.948475 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.948706 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.949055 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.949369 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.949714 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.950056 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.950355 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.950667 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.950973 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:39:38.951215 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 15:39:38.973689 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_db.sqlalchemy.engines [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:39.015327 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.context [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f0284d2-cfc5-416a-8f7b-7c6b0565ac94(cell1) {{(pid=108765) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 15:39:39.019555 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_concurrency.lockutils [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:39:39.021186 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_concurrency.lockutils [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:39:39.022001 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_concurrency.lockutils [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:39:39.024573 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_concurrency.lockutils [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:39:39.037328 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_db.sqlalchemy.engines [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:39.038974 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_db.sqlalchemy.engines [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:39.042274 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.context [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f0284d2-cfc5-416a-8f7b-7c6b0565ac94(cell1) {{(pid=108764) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 15:39:39.046543 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:39:39.048165 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:39:39.048991 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:39:39.050956 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:39:39.063725 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_db.sqlalchemy.engines [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:39.066280 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_db.sqlalchemy.engines [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:39.204690 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG oslo_db.sqlalchemy.engines [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:39.227421 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_db.sqlalchemy.engines [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:39:39.614718 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: WARNING keystonemiddleware.auth_token [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:39:39.621415 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: WARNING keystonemiddleware.auth_token [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:39:39.639756 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: WARNING keystonemiddleware.auth_token [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:39:39.646318 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: WARNING keystonemiddleware.auth_token [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:39:39.966173 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: WARNING keystonemiddleware.auth_token [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:39:39.971480 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: WARNING keystonemiddleware.auth_token [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:39:39.976615 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5589f9e5f9c0 pid: 108765 (default app) Jan 15 15:39:39.978744 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:39:39.979935 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jan 15 15:39:39.980370 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Sat Jan 15 15:39:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:39:39.989737 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: WARNING keystonemiddleware.auth_token [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:39:39.995717 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: WARNING keystonemiddleware.auth_token [None req-f677daa3-69e8-40e3-9026-c356024347ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:39:40.001066 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5589f9e5f9c0 pid: 108764 (default app) Jan 15 15:41:07.167273 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:07.168741 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002387 Jan 15 15:41:07.169145 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:07.597764 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-1279540d-7dac-4e31-81b0-d8bcc37d67fe admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:07.626384 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-1279540d-7dac-4e31-81b0-d8bcc37d67fe admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450684 Jan 15 15:41:07.627144 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Sat Jan 15 15:41:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:09.872094 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:09.873237 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-dee70ca8-660d-47e4-a112-718c82be8d45 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jan 15 15:41:09.873706 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:09.941431 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-ee498ea6-c1dc-4cb9-b2c3-a9daaf2b9ab2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:09.959819 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:41:09.959819 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: warnings.warn(msg) Jan 15 15:41:10.049516 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-ee498ea6-c1dc-4cb9-b2c3-a9daaf2b9ab2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.169571 Jan 15 15:41:10.050086 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:41:10.266709 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-f58d4f8f-3864-4f69-918f-e396a8271f2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:10.269118 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:41:10.269118 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: warnings.warn(msg) Jan 15 15:41:10.378193 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-f58d4f8f-3864-4f69-918f-e396a8271f2b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.319585 Jan 15 15:41:10.379128 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Sat Jan 15 15:41:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:12.632114 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-ee498ea6-c1dc-4cb9-b2c3-a9daaf2b9ab2 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:12.633141 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-ee498ea6-c1dc-4cb9-b2c3-a9daaf2b9ab2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 15 15:41:12.633541 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:12.745148 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-5a26df26-df04-49ec-b587-c49343e2381d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 5, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:12.762979 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:41:12.762979 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: warnings.warn(msg) Jan 15 15:41:12.880774 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-5a26df26-df04-49ec-b587-c49343e2381d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.240546 Jan 15 15:41:12.881439 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:41:12.894182 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-40d563b3-e822-4695-a632-c80959a10fd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:12.895836 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:41:12.895836 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: warnings.warn(msg) Jan 15 15:41:12.997478 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-40d563b3-e822-4695-a632-c80959a10fd9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106700 Jan 15 15:41:12.998009 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Sat Jan 15 15:41:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:15.277175 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-5a26df26-df04-49ec-b587-c49343e2381d admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:15.278179 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-5a26df26-df04-49ec-b587-c49343e2381d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jan 15 15:41:15.278643 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:15.339615 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5b089655-c374-4337-b9c2-6e8927280ae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "vcpus": 1, "swap": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:15.428964 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5b089655-c374-4337-b9c2-6e8927280ae8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144129 Jan 15 15:41:15.436822 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:41:15.441606 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-4232dadf-7417-4c5d-9cbe-4179d5b83ac6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:15.517342 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-4232dadf-7417-4c5d-9cbe-4179d5b83ac6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079374 Jan 15 15:41:15.517931 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Sat Jan 15 15:41:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:17.819210 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5b089655-c374-4337-b9c2-6e8927280ae8 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:17.820245 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5b089655-c374-4337-b9c2-6e8927280ae8 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 15 15:41:17.820659 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:41:17.880741 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-13ae2a40-101f-48b9-a930-a466e9a975c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:17.965848 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-13ae2a40-101f-48b9-a930-a466e9a975c6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139112 Jan 15 15:41:17.979201 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-d12fa5fd-b4f8-41d1-9960-2cfdcc336c7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:17.984254 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:41:18.060404 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-d12fa5fd-b4f8-41d1-9960-2cfdcc336c7f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084828 Jan 15 15:41:18.061091 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Sat Jan 15 15:41:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:20.333488 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-13ae2a40-101f-48b9-a930-a466e9a975c6 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:20.334489 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-13ae2a40-101f-48b9-a930-a466e9a975c6 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Jan 15 15:41:20.334883 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:20.391162 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-172d4167-c40e-4e4f-9cb6-a772e12a02d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "name": "ds4G"}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:20.478686 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-172d4167-c40e-4e4f-9cb6-a772e12a02d3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137765 Jan 15 15:41:20.479406 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:41:20.491857 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-f5fd8bb4-a6f6-46f5-9f2d-af310d3f2a83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:20.605521 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-f5fd8bb4-a6f6-46f5-9f2d-af310d3f2a83 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118005 Jan 15 15:41:20.606326 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Sat Jan 15 15:41:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:22.893765 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-172d4167-c40e-4e4f-9cb6-a772e12a02d3 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:22.894801 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-172d4167-c40e-4e4f-9cb6-a772e12a02d3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jan 15 15:41:22.895941 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:22.958104 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-4c08cbb5-302f-421b-ae19-34e102554d53 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:22.981882 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-4c08cbb5-302f-421b-ae19-34e102554d53 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079352 Jan 15 15:41:22.982514 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Sat Jan 15 15:41:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:41:25.362529 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-172d4167-c40e-4e4f-9cb6-a772e12a02d3 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:25.363540 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-172d4167-c40e-4e4f-9cb6-a772e12a02d3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jan 15 15:41:25.364421 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:25.433763 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-28a82fdb-71d1-4f7f-ad0c-14f1016bd9b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:25.542322 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-28a82fdb-71d1-4f7f-ad0c-14f1016bd9b9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.172056 Jan 15 15:41:25.542896 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:41:25.555971 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-482e42d3-f102-4b88-a162-ff9d294bd49e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:25.655356 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-482e42d3-f102-4b88-a162-ff9d294bd49e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102968 Jan 15 15:41:25.656128 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Sat Jan 15 15:41:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:41:27.909657 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-28a82fdb-71d1-4f7f-ad0c-14f1016bd9b9 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:27.911310 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-28a82fdb-71d1-4f7f-ad0c-14f1016bd9b9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jan 15 15:41:27.911772 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:27.971217 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-98ad4989-b946-4640-84a4-686d6962771d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "id": "2"}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:28.040168 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-98ad4989-b946-4640-84a4-686d6962771d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.121815 Jan 15 15:41:28.040855 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:41:28.054732 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-71c15556-6003-4a46-9cfe-acff1074cce1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:28.122316 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-71c15556-6003-4a46-9cfe-acff1074cce1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073210 Jan 15 15:41:28.123038 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Sat Jan 15 15:41:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:30.344644 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-98ad4989-b946-4640-84a4-686d6962771d admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:30.345655 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-98ad4989-b946-4640-84a4-686d6962771d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jan 15 15:41:30.346060 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:30.403724 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-8dca190d-47b0-4a84-a76a-6ea5347cca42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:30.484404 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-8dca190d-47b0-4a84-a76a-6ea5347cca42 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.132302 Jan 15 15:41:30.485113 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:41:30.497333 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-2def2ec8-641e-4091-96b5-43fb73d06522 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:30.568388 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-2def2ec8-641e-4091-96b5-43fb73d06522 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074535 Jan 15 15:41:30.568902 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Sat Jan 15 15:41:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:41:32.823863 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-8dca190d-47b0-4a84-a76a-6ea5347cca42 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:32.825507 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-8dca190d-47b0-4a84-a76a-6ea5347cca42 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Jan 15 15:41:32.826357 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:32.889633 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-3287c756-90f0-4c0d-9216-24bdbd987876 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:32.969910 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-3287c756-90f0-4c0d-9216-24bdbd987876 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135615 Jan 15 15:41:32.970795 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:41:32.983045 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-501c27b8-b014-42fe-bb03-d1e0b97c2d52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:33.071762 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-501c27b8-b014-42fe-bb03-d1e0b97c2d52 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092585 Jan 15 15:41:33.074525 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Sat Jan 15 15:41:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:35.359581 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-3287c756-90f0-4c0d-9216-24bdbd987876 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:35.361252 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-3287c756-90f0-4c0d-9216-24bdbd987876 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Jan 15 15:41:35.361862 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:35.423371 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-8f3dd68f-5067-4af4-b543-b76e16c7029b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "swap": 0, "rxtx_factor": 1.0, "id": "5"}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:35.535800 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-8f3dd68f-5067-4af4-b543-b76e16c7029b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.167153 Jan 15 15:41:35.536928 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Sat Jan 15 15:41:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:41:35.548251 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-ccfc634f-10fc-403d-9074-9dedf726431c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:41:35.642517 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-ccfc634f-10fc-403d-9074-9dedf726431c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097953 Jan 15 15:41:35.643711 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Sat Jan 15 15:41:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:41:58.643404 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-8f3dd68f-5067-4af4-b543-b76e16c7029b admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:58.644949 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-8f3dd68f-5067-4af4-b543-b76e16c7029b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Jan 15 15:41:58.645339 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:41:58.702394 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-8b82e9ed-cadb-4b8a-8065-f613693adac5 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:41:58.719088 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-8b82e9ed-cadb-4b8a-8065-f613693adac5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067867 Jan 15 15:41:58.719668 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Sat Jan 15 15:41:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:00.071034 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-8f3dd68f-5067-4af4-b543-b76e16c7029b admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:00.072027 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-8f3dd68f-5067-4af4-b543-b76e16c7029b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jan 15 15:42:00.072470 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:00.262280 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-46807e84-6234-47cd-ab45-3bdfa430353d admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:00.267684 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.wsgi [None req-46807e84-6234-47cd-ab45-3bdfa430353d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 15 15:42:00.268275 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-46807e84-6234-47cd-ab45-3bdfa430353d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:42:00.269131 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-46807e84-6234-47cd-ab45-3bdfa430353d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056792 Jan 15 15:42:00.269638 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Jan 15 15:42:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 15 15:42:00.278770 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-e714e344-b1b0-4dfb-ad5a-9461a5866b53 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:00.298684 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-e714e344-b1b0-4dfb-ad5a-9461a5866b53 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023413 Jan 15 15:42:00.299222 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Jan 15 15:42:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:00.309288 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-1470d44c-7fd3-417e-9616-31919dae7c92 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:00.330115 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-1470d44c-7fd3-417e-9616-31919dae7c92 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024412 Jan 15 15:42:00.330639 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Jan 15 15:42:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:00.339632 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-f6ecf95f-6f94-479d-9d6c-b5872808ff8a admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:00.344976 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.wsgi [None req-f6ecf95f-6f94-479d-9d6c-b5872808ff8a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 15 15:42:00.345541 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-f6ecf95f-6f94-479d-9d6c-b5872808ff8a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:42:00.346319 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-f6ecf95f-6f94-479d-9d6c-b5872808ff8a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010176 Jan 15 15:42:00.346814 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Jan 15 15:42:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 15:42:01.612975 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-1470d44c-7fd3-417e-9616-31919dae7c92 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:01.614026 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-1470d44c-7fd3-417e-9616-31919dae7c92 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Jan 15 15:42:01.614456 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:01.807592 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-dad0dfb1-7d02-4841-ab31-85ba5dc463c8 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:01.813671 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.wsgi [None req-dad0dfb1-7d02-4841-ab31-85ba5dc463c8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 15 15:42:01.814233 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-dad0dfb1-7d02-4841-ab31-85ba5dc463c8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:42:01.815015 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-dad0dfb1-7d02-4841-ab31-85ba5dc463c8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057921 Jan 15 15:42:01.816101 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Jan 15 15:42:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 15:42:01.825472 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-dd29299c-c82e-40ae-ab2e-dec1426629c6 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:01.838913 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-dd29299c-c82e-40ae-ab2e-dec1426629c6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017049 Jan 15 15:42:01.839437 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Jan 15 15:42:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:01.848583 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-f4249a42-4397-45ee-92fd-f5d7a228f212 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:01.861684 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-f4249a42-4397-45ee-92fd-f5d7a228f212 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016601 Jan 15 15:42:01.862690 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Jan 15 15:42:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:01.871764 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-8bfd2296-294b-41a7-a68f-a395b2faa765 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:01.876910 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.wsgi [None req-8bfd2296-294b-41a7-a68f-a395b2faa765 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 15 15:42:01.877460 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-8bfd2296-294b-41a7-a68f-a395b2faa765 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:42:01.878988 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-8bfd2296-294b-41a7-a68f-a395b2faa765 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010040 Jan 15 15:42:01.879471 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Jan 15 15:42:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 15 15:42:03.138407 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-f4249a42-4397-45ee-92fd-f5d7a228f212 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:03.139471 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-f4249a42-4397-45ee-92fd-f5d7a228f212 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 15 15:42:03.139871 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:03.332908 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-3150a842-2b7a-40b8-91c2-ec0feb5673c5 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:03.338215 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.wsgi [None req-3150a842-2b7a-40b8-91c2-ec0feb5673c5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 15 15:42:03.338771 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-3150a842-2b7a-40b8-91c2-ec0feb5673c5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:42:03.339551 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-3150a842-2b7a-40b8-91c2-ec0feb5673c5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057356 Jan 15 15:42:03.340049 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Jan 15 15:42:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 15:42:03.350732 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-aadf01f4-342a-48e6-87a8-635fc5db0a52 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:03.364655 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-aadf01f4-342a-48e6-87a8-635fc5db0a52 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017726 Jan 15 15:42:03.365175 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Jan 15 15:42:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:03.374583 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:03.387792 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016935 Jan 15 15:42:03.388354 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Jan 15 15:42:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:03.397283 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-b373670a-f7ef-4712-b253-27b3e1a9537f admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:03.402287 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.wsgi [None req-b373670a-f7ef-4712-b253-27b3e1a9537f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 15 15:42:03.402842 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-b373670a-f7ef-4712-b253-27b3e1a9537f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:42:03.403613 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-b373670a-f7ef-4712-b253-27b3e1a9537f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009857 Jan 15 15:42:03.404116 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Jan 15 15:42:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 15:42:04.671682 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:04.672696 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 15 15:42:04.673087 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:04.868875 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-39e3f515-3368-431f-a48b-91d9db66d258 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:42:04.945827 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-39e3f515-3368-431f-a48b-91d9db66d258 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.128925 Jan 15 15:42:04.946368 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Jan 15 15:42:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:42:06.206625 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:06.207609 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Jan 15 15:42:06.208002 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:06.399008 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-9d1b7507-020c-4ceb-95a8-f1f99951acbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:42:06.482529 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-9d1b7507-020c-4ceb-95a8-f1f99951acbf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.134062 Jan 15 15:42:06.483067 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Jan 15 15:42:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:42:07.745371 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:07.750962 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Jan 15 15:42:07.750962 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:07.941597 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-22d60472-afbb-49f2-9c5b-8aef3888f809 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:42:08.003179 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-22d60472-afbb-49f2-9c5b-8aef3888f809 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.113332 Jan 15 15:42:08.003660 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Jan 15 15:42:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:42:09.256994 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:09.258009 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jan 15 15:42:09.258404 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:09.449373 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-2ada72f5-b01e-4a37-96ae-0ca30489e549 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:42:09.562570 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-2ada72f5-b01e-4a37-96ae-0ca30489e549 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.163986 Jan 15 15:42:09.563121 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Jan 15 15:42:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:42:10.822496 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:10.823488 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jan 15 15:42:10.823885 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:11.018584 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-09a7391b-cb98-4981-86c3-230e19a74b18 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:11.038133 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-09a7391b-cb98-4981-86c3-230e19a74b18 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070480 Jan 15 15:42:11.038606 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Sat Jan 15 15:42:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:56.856576 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:56.861542 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-5f08f42b-102e-4563-bee0-a492ab54db88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jan 15 15:42:56.861542 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Sat Jan 15 15:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:42:56.915525 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-f7aa4351-b94d-48ab-bcdd-27a9dc57fc6d admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:56.935832 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-f7aa4351-b94d-48ab-bcdd-27a9dc57fc6d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071693 Jan 15 15:42:56.936395 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Sat Jan 15 15:42:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:42:56.957689 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-265b1c1a-e91c-4f1c-a793-81b7818597a6 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:56.965164 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-265b1c1a-e91c-4f1c-a793-81b7818597a6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011172 Jan 15 15:42:56.965672 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Sat Jan 15 15:42:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:42:56.976958 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-3df5c700-2f6b-4646-8a56-6b226ebd454e admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:56.984433 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-3df5c700-2f6b-4646-8a56-6b226ebd454e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010906 Jan 15 15:42:56.984933 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Sat Jan 15 15:42:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:42:56.996395 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-6fb94ce6-00bc-411b-95ac-bef61c068955 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:57.003666 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-6fb94ce6-00bc-411b-95ac-bef61c068955 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010641 Jan 15 15:42:57.004196 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Sat Jan 15 15:42:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:42:57.014815 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:42:57.022398 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010920 Jan 15 15:42:57.022904 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Sat Jan 15 15:42:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:44:50.473095 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-c4d64614-b92f-4a5c-9647-adaaa95ccfcc tempest-verify_tempest_config-1026348465 tempest-verify_tempest_config-1026348465-project] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:44:50.475063 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-c4d64614-b92f-4a5c-9647-adaaa95ccfcc tempest-verify_tempest_config-1026348465 tempest-verify_tempest_config-1026348465-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105003 Jan 15 15:44:50.475591 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 34/69] 10.222.0.36 () {58 vars in 1133 bytes} [Sat Jan 15 15:44:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:46:19.273928 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:19.274956 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jan 15 15:46:19.275348 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 36/70] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:46:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:46:19.534571 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-1af374de-1f7a-42c7-a509-fad39872062d admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:19.535748 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:46:19.535748 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: warnings.warn(msg) Jan 15 15:46:19.537299 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-1af374de-1f7a-42c7-a509-fad39872062d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:19.537732 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-1af374de-1f7a-42c7-a509-fad39872062d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:19.538522 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-1af374de-1f7a-42c7-a509-fad39872062d admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:19.538945 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-1af374de-1f7a-42c7-a509-fad39872062d admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:19.574112 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-1af374de-1f7a-42c7-a509-fad39872062d admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155053 Jan 15 15:46:19.574673 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 35/71] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Jan 15 15:46:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:46:20.852282 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:20.853273 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 15 15:46:20.853720 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 37/72] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:46:21.049272 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-6a82db3a-4a4c-493e-8388-a356129eb000 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:21.050438 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:46:21.050438 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: warnings.warn(msg) Jan 15 15:46:21.052256 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-6a82db3a-4a4c-493e-8388-a356129eb000 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:21.052695 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-6a82db3a-4a4c-493e-8388-a356129eb000 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:21.053484 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-6a82db3a-4a4c-493e-8388-a356129eb000 admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:21.053907 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-6a82db3a-4a4c-493e-8388-a356129eb000 admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:21.074061 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-6a82db3a-4a4c-493e-8388-a356129eb000 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077028 Jan 15 15:46:21.074582 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 36/73] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Jan 15 15:46:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:46:32.759178 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:32.760172 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jan 15 15:46:32.760561 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 38/74] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:46:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:46:32.956010 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-e64865d0-1ec3-4ec0-ac39-0f4ce95aa4cc admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:32.957228 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:46:32.957228 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: warnings.warn(msg) Jan 15 15:46:32.958760 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e64865d0-1ec3-4ec0-ac39-0f4ce95aa4cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:32.959197 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e64865d0-1ec3-4ec0-ac39-0f4ce95aa4cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:32.960009 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e64865d0-1ec3-4ec0-ac39-0f4ce95aa4cc admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:32.960454 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e64865d0-1ec3-4ec0-ac39-0f4ce95aa4cc admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:32.985080 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-e64865d0-1ec3-4ec0-ac39-0f4ce95aa4cc admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082926 Jan 15 15:46:32.985559 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 37/75] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Jan 15 15:46:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:46:34.251351 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: DEBUG nova.api.openstack.wsgi [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] Calling method '>' {{(pid=108765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:34.252385 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: INFO nova.api.openstack.requestlog [None req-fdf5c621-2645-4770-ae62-a158ae6e5839 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jan 15 15:46:34.252782 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: [pid: 108765|app: 0|req: 39/76] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Jan 15 15:46:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:46:34.445873 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG nova.api.openstack.wsgi [None req-e34a8e0e-68cf-4083-b3dd-c1ae9a029412 admin admin] Calling method '>' {{(pid=108764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:46:34.447351 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:46:34.447351 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: warnings.warn(msg) Jan 15 15:46:34.448909 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e34a8e0e-68cf-4083-b3dd-c1ae9a029412 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:34.449339 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e34a8e0e-68cf-4083-b3dd-c1ae9a029412 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:34.450140 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e34a8e0e-68cf-4083-b3dd-c1ae9a029412 admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:46:34.450582 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: DEBUG oslo_concurrency.lockutils [None req-e34a8e0e-68cf-4083-b3dd-c1ae9a029412 admin admin] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:46:34.473111 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: INFO nova.api.openstack.requestlog [None req-e34a8e0e-68cf-4083-b3dd-c1ae9a029412 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079090 Jan 15 15:46:34.473674 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: [pid: 108764|app: 0|req: 38/77] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Jan 15 15:46:34 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:47:30.406578 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: Sat Jan 15 15:47:30 2022 - graceful shutdown triggered... Jan 15 15:47:30.407131 dv-cinder-824819-1-iscsi devstack@n-api.service[108764]: Gracefully killing worker 1 (pid: 108764)... Jan 15 15:47:30.408697 dv-cinder-824819-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 15 15:47:30.409818 dv-cinder-824819-1-iscsi devstack@n-api.service[108765]: Gracefully killing worker 2 (pid: 108765)... Jan 15 15:47:31.407713 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: worker 1 buried after 1 seconds Jan 15 15:47:31.408129 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: worker 2 buried after 1 seconds Jan 15 15:47:31.408129 dv-cinder-824819-1-iscsi devstack@n-api.service[108763]: goodbye to uWSGI. Jan 15 15:47:31.409376 dv-cinder-824819-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 15 15:47:31.409926 dv-cinder-824819-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 15 15:47:31.412739 dv-cinder-824819-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 15 15:47:31.425295 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 15 15:47:31 2022] *** Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: nodename: dv-cinder-824819-1-iscsi Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: machine: x86_64 Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: clock source: unix Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: pcre jit disabled Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: detected number of CPU cores: 4 Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: current working directory: / Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: detected binary path: /usr/bin/uwsgi-core Jan 15 15:47:31.426714 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: your processes number limit is 47680 Jan 15 15:47:31.427529 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: your memory page size is 4096 bytes Jan 15 15:47:31.427529 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: detected max file descriptor number: 2048 Jan 15 15:47:31.427529 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: lock engine: pthread robust mutexes Jan 15 15:47:31.427529 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: thunder lock: enabled Jan 15 15:47:31.427529 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 15 15:47:31.427529 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 15 15:47:31.473929 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: Python main interpreter initialized at 0x55693f4689c0 Jan 15 15:47:31.473929 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: python threads support enabled Jan 15 15:47:31.473929 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: your server socket listen backlog is limited to 100 connections Jan 15 15:47:31.473929 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: your mercy for graceful operations on workers is 90 seconds Jan 15 15:47:31.474366 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: mapped 403077 bytes (393 KB) for 2 cores Jan 15 15:47:31.474366 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: *** Operational MODE: preforking *** Jan 15 15:47:31.474633 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: *** uWSGI is running in multiple interpreter mode *** Jan 15 15:47:31.474633 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: spawned uWSGI master process (pid: 123203) Jan 15 15:47:31.474837 dv-cinder-824819-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 15 15:47:31.475416 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: spawned uWSGI worker 1 (pid: 123220, cores: 1) Jan 15 15:47:31.475935 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: spawned uWSGI worker 2 (pid: 123221, cores: 1) Jan 15 15:47:31.476224 dv-cinder-824819-1-iscsi devstack@n-api.service[123203]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 15 15:47:33.502658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:47:33.502658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: from cryptography.utils import int_from_bytes Jan 15 15:47:33.503349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:47:33.503349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: from cryptography.utils import int_from_bytes Jan 15 15:47:33.504014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:47:33.504014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: from cryptography.utils import int_from_bytes Jan 15 15:47:33.504520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 15:47:33.504520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: from cryptography.utils import int_from_bytes Jan 15 15:47:35.921349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 15:47:35.921897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 15:47:35.922334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 15:47:35.922508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 15:47:35.922775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 15:47:35.923170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.923506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.923836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.924181 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.924776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.925096 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.925429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.925763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.926098 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.926372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.926696 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.927027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824819-1-iscsi {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.927358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.927674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.927997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.928354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.928669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.929000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.929313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.929822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.930277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.930593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.931106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.931280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.931588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.931910 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.932268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.932590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.932925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.933249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.933658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824819-1-iscsi {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.933990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.934312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.934672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.934888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 15:47:35.935282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.935377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 15:47:35.935468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.935729 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.935883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 15:47:35.936075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.936289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 15:47:35.936428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.936546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 15:47:35.936751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.936920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.937092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.937245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.937417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.937570 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.937736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.937895 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.938066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.938228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.938383 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.938542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.938705 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.938866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.939005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.939189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.939334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.939522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.939648 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.939786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.939963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.940105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.940244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.940462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824819-1-iscsi {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.940553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.940785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.940885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.941098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.941198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.941412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.941556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.941755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.941863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.942000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.942101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.942328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.942429 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.942648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.942762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.942979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.943200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.943321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.943565 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.943677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.943874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.943986 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.944208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.944308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.944552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.944662 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.944868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.944979 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.945177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.945274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.945501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.945610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.945814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.945943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.946142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.946251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.946461 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.946569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.946783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.946891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824819-1-iscsi {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.947168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.947275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.948289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.948466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.948602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.948887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949140 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.949877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.950143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.950270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.950921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951481 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.951984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.952102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.952287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.952387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.952607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.952721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.952928 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.953066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.953259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.953363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.953568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.953676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.953880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.953989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.954137 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.954252 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.954448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.954546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.954777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.954874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.955090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.955178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.955407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.955495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.955659 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.955748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.955915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.956007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.956265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.956360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.956593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.956690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.956906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.957003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.957225 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.957328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.957537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.957626 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.957847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.957941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.958163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.958280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.958475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.958580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.958786 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.958892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.959093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.959200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.959418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.959527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.959730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.959858 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.960046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.960170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.960392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.960505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.960713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.960816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.961028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.961134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.961351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.961456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.961663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.961776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.961976 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.962095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.962303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.962404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.962613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.962702 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.962936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.963046 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.963250 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.963353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.963562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.963667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.963873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.963987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.964282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.964385 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.964516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.964606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.964830 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.964929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.965145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.965237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.965395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.965485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.965702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.965800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.966612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.966783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.967187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.967394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.967540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.967644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.967808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.967907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.968127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.968267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.968469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.968574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.968778 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.968874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.969094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.969184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.969408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.969512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.969719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.969817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.970095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.970202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.970334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.970425 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.970645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.970757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.970956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.971087 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.971264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.971407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.971585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.971731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.971911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.972095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.972229 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.972412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.972544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.972734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.972836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.973057 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.973148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.973384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.973499 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.973712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.973811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.974049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.974140 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.974373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.974470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.974681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.974770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.974989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.975079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.975311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.975414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.975621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.975725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.975929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.976019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.976277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.976386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.976582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.976673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.976890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.976979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.977214 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.977313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.977525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.977622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.977836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.977925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.978142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.978240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.978450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.978540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.978760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.978887 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.979075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.979178 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.979371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.979462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.979678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.979781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.979980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.980070 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.980328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.980437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.980654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.980754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.980966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.981071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.981276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.981367 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.981632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.981735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.982025 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.982208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 15:47:35.982343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.982665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.982755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.982981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.983087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.983312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.983410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.983646 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.983742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.983960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.984063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.984329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.984435 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.984648 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.984746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.984971 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.985076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.985291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.985391 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.985606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.985697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.985926 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.986026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.986247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.986344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.986561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.986656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.986885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.986976 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.987212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.987302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.987524 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.987620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.987855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.987953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.988189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.988295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.988510 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.988608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.988824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.988919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.989144 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.989287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.989463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.989561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.989784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.989874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.990097 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.990192 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.990424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.990611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.990743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.990841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.991076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.991165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.991406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.991507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.991720 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.991816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.992043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.992132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.992405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.992551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.992717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.992813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.993034 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.993124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.993350 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.993440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.993661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.993758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.993975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.994120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.994286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.994398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.994616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.994722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.994916 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.995014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.995225 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.995321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.995536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.995627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.995846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.995944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.996179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.996311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.996494 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.996598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.996819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.996922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.997167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.997261 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.997603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.997693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.997929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.998176 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.998288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.998492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.998583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.998812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.998930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.999130 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.999279 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.999440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.999608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.999758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:35.999943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.000075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.000292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.000432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.000624 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.000762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.000947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.001077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.001271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.001439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.001594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.001684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.001918 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.002017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.002252 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.002342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.002577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.002689 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.002900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.002999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.003215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.003306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.003530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.003622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.003851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.003940 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.004181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.004288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.004501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.004651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.004824 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.004922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.005158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.005260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.005468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.005568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.005794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.005885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.006120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.006211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.006439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.006538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.006747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.006848 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.007064 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.007155 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.007373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.007473 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.007681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.007810 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.007987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.008080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.008340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.008431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.008649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.008782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.008960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.009077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.009269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.009371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.009576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.009666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.009884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.009983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.010208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.010300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.010518 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.010614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.010824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.010923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.011132 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.011230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.011439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.011537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.011784 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.011957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.012094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.012214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.012449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.012561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.013291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.013438 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.013681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.013847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.014082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.014226 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.014361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.014549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.014647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.014872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.014971 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.015188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.015287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.015508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.015599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.015826 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.015923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.016160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.016336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.016495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.016587 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.016812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.016917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.017134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.017234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.017454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.017552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.017780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.017952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.018094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.018189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.018402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.018500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.018712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.018803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.019030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.019138 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.019346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.019435 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.019660 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.019757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.019992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.020091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.020339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.020431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.020654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.020751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.020970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.021068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.021281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.021377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.021592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.021687 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.021905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.021997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.022221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.022318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.022542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.022643 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.022872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.022999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.023173 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.023268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.023486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.023583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.023807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.023951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.024117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.024251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.024479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.024734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.024836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.025036 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.025153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.025425 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.025748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.025871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.026059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.026203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.026415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.026731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.026854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.027055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.027181 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.027392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.027496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.027706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.027807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.028022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.028160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.028358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.028555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.028951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.029217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.029478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.029592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.029827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.030141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.030241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.030466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.030563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.030785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.030884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.031101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.031227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.031421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.031520 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.031736 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.031830 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.032044 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.032167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.032382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.032513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.032699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.032825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.033030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.033152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.033343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.033438 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.033664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.033771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.034042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.034175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.034335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.034429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.034688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.034811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.034895 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.035049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.035316 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.035422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.035506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.035578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.035984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.036092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.036198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.036275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.036521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.036625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.036831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.036926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.037118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.037210 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.037398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.037491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.037699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.037800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.038591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.038681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.038681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.038855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.038936 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.039031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.039109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.040126 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.040320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.040474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.040624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.040787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.040954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.041114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.041275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.041435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.041602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.041763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.041930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.042090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.042242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.042392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.042551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.042710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.042871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.043116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.043275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.043426 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.043589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.043747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.043915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.044677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.044782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.044871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.044969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.045909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.046007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.046175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.046268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.046503 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.046609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.046816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.046922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.047141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.047234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.047459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.047551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.047771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.047875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.048078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.048301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.048406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.048501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.048717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.048825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.049026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.049144 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.049334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.049697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.049908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.050050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.050222 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.050316 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.050532 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.050623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.050841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.050941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.051152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.051261 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.051468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.051563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.051785 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.051876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.052093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.052247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.052442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.052535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.052752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.052851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.053065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.053202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.053378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.053476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.053688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.053786 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.053995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.054099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.054304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.054396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.054621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.054716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.054945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.055044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.055268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.055357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.055579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.055714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.055898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.055998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.056237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.056346 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.056556 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.056682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.056870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.056985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.057185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.057289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.057497 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.057609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.057803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.057929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.058115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.058393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.058556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.058709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.059129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.059350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.059598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.060341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.060520 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.060687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.060849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.061002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.061241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.061424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.061594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.061765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.061934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.062094 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.062247 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.062406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.062565 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.062766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.062937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.063107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.063347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.063507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.063666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.063828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.063982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.064272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.064443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.064608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.064761 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.065011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.065170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.065340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.065502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.065759 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.065917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.066088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.066257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.066422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.066574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.066734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.066899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.067053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.067204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.067355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.067516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.067668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.067829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.067991 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.068162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.068321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.068483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.068635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.068796 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.068948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.069108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.069267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.069419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.069599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.069830 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.069989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.070151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.070314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.070467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.070627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.070780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.070944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.071102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.071262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.071421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.071597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.071758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.071917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.072069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.072258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.072258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.072575 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.072727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.072885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.073049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.073201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.073370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.073603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.073774 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.073927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.074085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.074237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.074397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.074550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.074701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.074865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.075043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.075274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.075579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.075770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.075995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.076956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077629 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.077991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.078232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.078328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.078608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.078698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.078956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.079055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.079283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.079371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.079605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.079730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.079920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.080072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.080327 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.080446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.080652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.080772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.080987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.081085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.081302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.081428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.081619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.081885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.081988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.082226 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.082324 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.082548 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.082638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.082880 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.082976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.083255 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.083386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.083653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.083780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.083916 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.084051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.084277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.084409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.084602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.084742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.084928 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.085066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.085258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.085396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.085583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.085722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.085909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.086040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.086235 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.086377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.086560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.086697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.086881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.087018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.087216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.087358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.087535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.087665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.087855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.087992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.088189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.088333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.088509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.088650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.088836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.088967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.089151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.089284 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.089481 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.089610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.089814 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.089952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.090228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.090358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.090551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.090681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.090870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.091016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.091312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.091527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.091713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.091854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.091994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.092126 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.092342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.092482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.092665 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.092803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.092990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.093136 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.093317 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.093455 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.093634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.093787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.093983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.094126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.094303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.094434 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.094624 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.094748 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.094942 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.095081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.095257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.095395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.095572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.095701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.095903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.096042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.096240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.096371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.096576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.096706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.096889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.097019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.097204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.097336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.097536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.097673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.097846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.097975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.098172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.098315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.098489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.098693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.098812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.098937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.099102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.099239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.099423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.099622 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.099779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.099970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.100101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.100319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.100463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.100653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.100792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.100986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.101117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.101320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.101463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.101634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.101769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.101958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.102093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.102278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.102424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.102610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.102741 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.102943 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.103084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.103262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.103392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.103583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.103713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.103896 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.104031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.104245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.104383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.104563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.104702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.104877 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.105007 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.105194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.105325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.105505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.105641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.105815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.105952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.106127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.106257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.106458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.107094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.107377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.107616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.107801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.107945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.108082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.108253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.108381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.108550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.108691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.108866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.108997 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.109180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.109317 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.109534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.109673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.109851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.109983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.110167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.110296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.110486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.110617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.110799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.110929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.111112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.111251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.111441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.111579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.111752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.111889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.112083 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.112246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.112433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.112564 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.112755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.112884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.113079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.113218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.113389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.113526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.113713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.113849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.114026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.114165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.114338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.114469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.114650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.114781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.114966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.115104 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.115287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.115416 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.115713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.115859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.116002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.116198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.116340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.116529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.116675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.116857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.116996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.117182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.117314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.117505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.117636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.117831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.117970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.118152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.118283 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.118474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.118612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.118795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.118927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.119114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.119243 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.119431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.119561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.119743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.119873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.120056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.120218 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.120393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.120536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.120709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.120841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.121020 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.121149 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.121329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.121468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.121639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.121768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.121966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.122102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.122309 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.122621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.122841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.123056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.123201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.123329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.123455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.123592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.123721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.123919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.124051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.124269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.124412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.124596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.124728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.124926 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.125071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.125253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.125397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.125579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.125709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.125900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.126037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.126226 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.126366 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.126549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.126673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.126885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.127016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.127210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.127346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.127536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.127673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.127857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.127987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.128200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.128348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.128527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.128656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.128849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.129124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.129338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.129477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.129614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.129741 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.129870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.130044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.130184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.130379 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.130633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.130769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.130969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.131114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.131292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.131447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.131611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.131750 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.131931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.132070 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.132275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.132407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.132594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.132731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.132908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.133048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.133227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.133363 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.133543 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.133675 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.133856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.133985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.134186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.134329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.134503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.134711 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.134851 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.135048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.135194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.135407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.135538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.135736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.135868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.136074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.136278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.136408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.136533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.136749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.136877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.137064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.137195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.137383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.137512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.137697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.138368 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.138637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.138967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.139146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.139380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.139519 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.139649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.139803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.139942 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.140129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.140291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.140480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.140612 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.140806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.140938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.141127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.141272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.141436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.141572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.141756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.141886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.142072 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.142213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.142386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.142517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.142698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.142835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.143018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.143156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.143331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.143471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.143643 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.143775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.143957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.144095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.144312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.144539 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.144680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.144865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.145007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.145207 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.145338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.145525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.145655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.145847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.145980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.146162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.146299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.146480 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.146612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.146794 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.146934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.147111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.147249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.147425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.147557 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.147735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.147865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.148049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.148195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.148388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.148519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.148718 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.148855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.149033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.149162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.149424 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.149574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.149724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.149863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.149992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.150119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.150501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.150639 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.150863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.150995 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.151194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.151325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.151532 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.151677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.151866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.151998 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.152215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.152351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.152536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.152681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.152854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.152985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.153171 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.153302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.154059 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.154274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.154472 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.154690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.154866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.155000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.155141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.155280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.155409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.155536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.155653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.155849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.156031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.156182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.156312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.156510 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.156641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.156883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.157023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.157162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.157299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.157485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.157615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.157800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.157931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.158112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.158251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.158431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.158561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.158745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.158883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.159057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.159188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.159371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.159522 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.159737 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.159862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.159980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.160108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.160320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.160460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.160640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.160771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.160954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.161084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.161274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.161417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.161588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.161718 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.161907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.162042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.162220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.162363 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.162551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.162695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.162866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.162996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.163178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.163387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.163523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.163650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.163805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.163941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.164154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.164298 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.164483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.164612 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.164803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.164946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.165160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.165291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.165492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.165629 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.165824 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.166029 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.166171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.166420 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.166550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.166741 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.166869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.167063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.167200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.167404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.167533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.167728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.167850 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.168046 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.168256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.168387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.168524 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.168707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.168836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.169028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.169177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.169408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.169632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.169954 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.170098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.170238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.170367 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.170485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.170617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.170747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.170951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.171087 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.171215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.171347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.171474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.171600 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.171744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.171910 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.172041 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.172256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.172390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.172577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.172710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.172897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.173027 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.173219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.173348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.173543 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.173684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.173856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.173985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.174171 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.174300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.174767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.174906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.175092 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.175221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.175416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.175552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.175739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.175870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.176060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.176232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.176403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.176541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.176729 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.176860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.177053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.177178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.177376 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.177517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.177704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.177836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.178031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.178163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.178365 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.178560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.178692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.178904 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.179041 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.179306 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.179442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.179622 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.179753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.179969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.180214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.180389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.180584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.180723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.180892 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.181035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.181270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.181407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.181581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.181713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.181893 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.182024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.182211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.182342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.182486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 15:47:36.182623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.182872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.183194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.183518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.183834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.184185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.184507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.184878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.185203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.185531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.185849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.186186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.186505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.186823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.187141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.187476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.187775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.188091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.188486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.188826 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.189142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.189475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.189800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.190126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.190448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.190767 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.191105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.191424 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.191750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.192071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.192442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.192768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.193096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.193433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.193768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.194102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.194438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.194796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.195116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.195476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.195814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.196186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.196480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.196796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 15:47:36.197046 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 15:47:36.207608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.222960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_db.sqlalchemy.engines [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.274591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.context [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f0284d2-cfc5-416a-8f7b-7c6b0565ac94(cell1) {{(pid=123221) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 15:47:36.279604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:47:36.281295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:47:36.282146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:47:36.284091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:47:36.290564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.context [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f0284d2-cfc5-416a-8f7b-7c6b0565ac94(cell1) {{(pid=123220) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 15:47:36.294732 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.295431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:47:36.296071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.297109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:47:36.297986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:47:36.300246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:47:36.311805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_db.sqlalchemy.engines [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.312685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_db.sqlalchemy.engines [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.460773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.476125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_db.sqlalchemy.engines [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 15:47:36.905544 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: WARNING keystonemiddleware.auth_token [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:47:36.912567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: WARNING keystonemiddleware.auth_token [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:47:36.932174 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: WARNING keystonemiddleware.auth_token [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:47:36.941641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: WARNING keystonemiddleware.auth_token [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:47:37.144822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: WARNING keystonemiddleware.auth_token [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:47:37.150050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: WARNING keystonemiddleware.auth_token [None req-9ad135f6-80df-4db5-918f-6ebe364eb53e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:47:37.156051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55693f4689c0 pid: 123221 (default app) Jan 15 15:47:37.173785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: WARNING keystonemiddleware.auth_token [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 15:47:37.179263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: WARNING keystonemiddleware.auth_token [None req-52c7208b-4a5a-4db8-a989-53c8455626c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 15:47:37.185220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55693f4689c0 pid: 123220 (default app) Jan 15 15:48:13.010615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c154334c-500b-4165-9b44-10c88938225d tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Action: 'create', calling method: .version_select at 0x7f21695f51f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1152277011"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:15.194925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c154334c-500b-4165-9b44-10c88938225d tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.457596 Jan 15 15:48:15.204259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1154 bytes} [Sat Jan 15 15:48:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3468 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 15 15:48:15.215646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-60e9270a-f35a-409c-8258-8673ab86d7fc tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694b4dc0>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:15.321861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c73a81fb-28f3-4f29-93de-4d3e00f31c4d tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f216961eee0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:15.457623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-60e9270a-f35a-409c-8258-8673ab86d7fc tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c" status: 200 len: 345 microversion: 2.1 time: 0.251101 Jan 15 15:48:15.458359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 2/2] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:15 2022] GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c => generated 345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:15.637604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1975050939", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "f97f9d7d-c1d8-4671-bfaf-495719187f23"}]}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:15.815058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.network.neutron [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] validate_networks() for [('f97f9d7d-c1d8-4671-bfaf-495719187f23', None, None, None, None, None)] {{(pid=123221) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:48:16.473432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c73a81fb-28f3-4f29-93de-4d3e00f31c4d tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6a71e5d2-1088-4aa2-9656-d3147b6f4568" status: 200 len: 349 microversion: 2.1 time: 1.654329 Jan 15 15:48:16.481757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1/3] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:14 2022] GET /compute/v2.1/os-volumes/6a71e5d2-1088-4aa2-9656-d3147b6f4568 => generated 349 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:16.488263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3c28dc82-c557-4b1b-af72-3e68b40107d6 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694f6dc0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:16.608561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3c28dc82-c557-4b1b-af72-3e68b40107d6 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c" status: 200 len: 346 microversion: 2.1 time: 0.125126 Jan 15 15:48:16.609138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:16 2022] GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:16.623091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-14124a92-d7e8-4f1b-8f8f-4295434ae971 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Action: 'create', calling method: .version_select at 0x7f21694b3790>, body: {"snapshot": {"volume_id": "48931413-30a8-492c-9f6e-c13110e0dd7c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1559698506"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:17.243485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Flavor limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:48:17.244275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Image limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:48:17.244825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Flavor pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:48:17.245467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Image pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:48:17.245968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:48:17.282262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:17.283267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:17.284755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:17.285369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:17.341982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Getting quotas for project ca064050918d4006b60e60198b66171d. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:48:17.345627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-14124a92-d7e8-4f1b-8f8f-4295434ae971 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.727717 Jan 15 15:48:17.346418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 3/5] 10.222.0.36 () {60 vars in 1161 bytes} [Sat Jan 15 15:48:16 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:17.357000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Getting quotas for user da755e3e160a455f95b793d2c1a91323 and project ca064050918d4006b60e60198b66171d. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:48:17.357711 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0d0e36f4-a669-481d-a550-8c0091752ed9 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694b3430>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:17.391847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Going to run 1 instances... {{(pid=123221) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:48:17.410294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:48:17.419625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0d0e36f4-a669-481d-a550-8c0091752ed9 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.065547 Jan 15 15:48:17.420307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 4/6] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:17 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:48:17.432131 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a02fd83e-1af7-4602-b6d2-7bf70a66ee2c tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694bf160>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:17.642085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e774efce-b1be-4f11-b098-28a00055e6d5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.178069 Jan 15 15:48:17.642849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 3/7] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:48:17.655229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6a836eca-42d1-42bf-afa9-d6e094223b3a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:17.655871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6a836eca-42d1-42bf-afa9-d6e094223b3a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:17.768164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a02fd83e-1af7-4602-b6d2-7bf70a66ee2c tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.340459 Jan 15 15:48:17.774461 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1139 bytes} [Sat Jan 15 15:48:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:48:17.781370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c07680c7-f682-4911-aca1-5389bb565f2a tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694c2040>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:17.861033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c07680c7-f682-4911-aca1-5389bb565f2a tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.085660 Jan 15 15:48:17.862002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 6/9] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:17 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:48:18.091684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6a836eca-42d1-42bf-afa9-d6e094223b3a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:18.122426 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6a836eca-42d1-42bf-afa9-d6e094223b3a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1215 microversion: 2.1 time: 0.471672 Jan 15 15:48:18.123227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 4/10] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:17 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1215 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:18.875210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-da33e5e1-ed1b-48df-8719-0a323aa657a2 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694bf9d0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:18.959189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-da33e5e1-ed1b-48df-8719-0a323aa657a2 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.088855 Jan 15 15:48:18.960026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 7/11] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:18 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:19.139111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5d0e2812-3296-474b-8279-cb4e731524e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:19.139772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5d0e2812-3296-474b-8279-cb4e731524e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:19.191565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5d0e2812-3296-474b-8279-cb4e731524e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:19.210335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5d0e2812-3296-474b-8279-cb4e731524e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1215 microversion: 2.1 time: 0.075405 Jan 15 15:48:19.211126 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 5/12] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:19 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:19.975195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-02254b93-11d6-498f-813f-06a458cbaed6 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694bf3a0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:20.025580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-02254b93-11d6-498f-813f-06a458cbaed6 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.057634 Jan 15 15:48:20.026751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 8/13] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:19 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:20.227715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:20.228369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:20.241164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:20.242512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:20.242698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:20.243214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:20.530167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:20.544289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ad4cdcca-8454-45c6-a0bd-594313275e2d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1219 microversion: 2.1 time: 0.319565 Jan 15 15:48:20.545215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 6/14] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:20 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1219 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:21.106440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7848512b-cccc-48de-bf9a-664b0e2243d2 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21694b3310>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:21.106440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7848512b-cccc-48de-bf9a-664b0e2243d2 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.045293 Jan 15 15:48:21.106440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 9/15] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:21 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:21.566006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:21.566818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:21.577584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:21.578127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:21.578932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:21.579377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:21.680988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:21.706861 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-872b753a-9700-4ce5-86d1-d2b5239364e2 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1219 microversion: 2.1 time: 0.128685 Jan 15 15:48:21.712747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:21 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:22.092733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c320152b-2597-4680-ad6e-d818829ccbd2 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f2168290280>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:22.181595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c320152b-2597-4680-ad6e-d818829ccbd2 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.093079 Jan 15 15:48:22.182985 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:22 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:48:22.261198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-104413143", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71e21a92-a3cc-4737-9cc7-2088c8b16b19"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:22.431926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] validate_networks() for [('71e21a92-a3cc-4737-9cc7-2088c8b16b19', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:48:22.726770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:22.728062 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:22.738672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:22.739551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:22.744369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:22.745463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:22.991703 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:23.005167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-92518ff1-2833-4a95-a031-220092a8317f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1219 microversion: 2.1 time: 0.282296 Jan 15 15:48:23.020538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:22 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1219 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:23.194597 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-13dddaa9-c8bf-4693-9527-4f5d6519433a tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f2168290430>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:23.249967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-13dddaa9-c8bf-4693-9527-4f5d6519433a tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.059866 Jan 15 15:48:23.253315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:23 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:23.945773 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:48:23.946275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:48:23.946953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:48:23.947632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:48:23.948248 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:48:23.985185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:23.986506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:23.988492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:23.989264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:24.033931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Getting quotas for project 7f1d550b942e4fbd824454e5776498d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:48:24.041723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Getting quotas for user 36f431ab7b054b618142174b03491104 and project 7f1d550b942e4fbd824454e5776498d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:48:24.057299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:48:24.061233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:48:24.204078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4c83b969-061a-4aa6-99a8-0fc5c4224783 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'create', calling method: .version_select at 0x7f21682b94c0>, body: {"keypair": {"name": "tempest-keypair-283530342"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:24.234911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-4c83b969-061a-4aa6-99a8-0fc5c4224783 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:48:24.239474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-4c83b969-061a-4aa6-99a8-0fc5c4224783 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for user 36b1f031a12243b59ef309631e015afb and project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:48:24.299162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ce0b402c-b0dd-4426-bc40-5b6b8f6de3bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.466134 Jan 15 15:48:24.299807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:48:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:48:24.307552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:24.308277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:24.349846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:24.350625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:24.365490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:24.369200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:24.771396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:24.789867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-4c83b969-061a-4aa6-99a8-0fc5c4224783 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:48:24.802912 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-4c83b969-061a-4aa6-99a8-0fc5c4224783 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for user 36b1f031a12243b59ef309631e015afb and project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:48:24.816972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-75310b78-507d-4db1-8856-040fce3982ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1275 microversion: 2.1 time: 0.514370 Jan 15 15:48:24.819297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 11/21] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:24 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1275 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:24.837028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-863d5bba-b5a8-4b30-9bef-4b2193dac41e tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f21682db8b0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:24.838922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4c83b969-061a-4aa6-99a8-0fc5c4224783 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.879980 Jan 15 15:48:24.845280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 11/22] 10.222.0.36 () {62 vars in 1198 bytes} [Sat Jan 15 15:48:23 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 887 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 15:48:24.852529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c0627091-6218-4e38-85c1-038018d5ed92 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21682fb940>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:25.114708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-863d5bba-b5a8-4b30-9bef-4b2193dac41e tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/862b27aa-8002-4837-a78e-09492d08799c" status: 200 len: 351 microversion: 2.1 time: 0.294085 Jan 15 15:48:25.130448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:24 2022] GET /compute/v2.1/os-volumes/862b27aa-8002-4837-a78e-09492d08799c => generated 351 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:25.135726 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-92bd64da-561d-438e-a30c-9c2364584d5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:25.137948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-92bd64da-561d-438e-a30c-9c2364584d5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:25.183815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c0627091-6218-4e38-85c1-038018d5ed92 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 288 microversion: 2.1 time: 0.336740 Jan 15 15:48:25.184618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:24 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 288 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:25.196959 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a7e256a8-2cf8-4709-8862-5c6551c024d5 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21682b9af0>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:25.256879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-92bd64da-561d-438e-a30c-9c2364584d5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:25.299138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-92bd64da-561d-438e-a30c-9c2364584d5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1221 microversion: 2.1 time: 0.166936 Jan 15 15:48:25.299743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:25.505664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1865779312", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71e21a92-a3cc-4737-9cc7-2088c8b16b19"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:25.628250 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] validate_networks() for [('71e21a92-a3cc-4737-9cc7-2088c8b16b19', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:48:25.852660 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a7e256a8-2cf8-4709-8862-5c6551c024d5 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 202 len: 0 microversion: 2.1 time: 0.661015 Jan 15 15:48:25.853859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1253 bytes} [Sat Jan 15 15:48:25 2022] DELETE /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:48:25.859361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:25.859891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:25.878330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:25.878883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:25.879724 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:25.882376 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:26.113876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:26.124575 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-908d2d76-93b3-4f93-ba89-f2af754c23aa tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1273 microversion: 2.1 time: 0.269257 Jan 15 15:48:26.125500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:25 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:26.135863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d00b3c8b-d464-4643-b092-f34ba85c8f06 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f216824f940>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:26.440530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d00b3c8b-d464-4643-b092-f34ba85c8f06 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 200 len: 287 microversion: 2.1 time: 0.313859 Jan 15 15:48:26.445403 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:26 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 287 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:27.142784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:27.143451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:27.162541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:27.162817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:27.163658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:27.164115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:27.500674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:27.518992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-90d1e4b5-9ff7-4120-add4-a55edb6defa7 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1273 microversion: 2.1 time: 0.380831 Jan 15 15:48:27.522337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:27 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1273 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:27.543036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6dfa3850-8e77-4913-a68f-6859212bc2be tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f2168b71700>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:27.696930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:48:27.697530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:48:27.698148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:48:27.699172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:48:27.699686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:48:27.723078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:27.723632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:27.724590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:27.728824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:27.808256 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Getting quotas for project 7f1d550b942e4fbd824454e5776498d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:48:27.808256 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Getting quotas for user 36f431ab7b054b618142174b03491104 and project 7f1d550b942e4fbd824454e5776498d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:48:27.808256 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:48:27.808680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:48:27.977398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1a419448-feff-466e-a6bc-fdbae2d4adbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.479015 Jan 15 15:48:27.978139 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 14/30] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:48:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:48:27.984407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-6dfa3850-8e77-4913-a68f-6859212bc2be tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] HTTP exception thrown: Snapshot 08dc929b-f7c1-4152-866b-efc0ad80982d could not be found. Jan 15 15:48:27.985021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6dfa3850-8e77-4913-a68f-6859212bc2be tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Returning 404 to user: Snapshot 08dc929b-f7c1-4152-866b-efc0ad80982d could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:48:27.990768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0316ad00-9955-44e4-ab0c-a8a5ac27e5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:27.991925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6dfa3850-8e77-4913-a68f-6859212bc2be tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d" status: 404 len: 111 microversion: 2.1 time: 0.468232 Jan 15 15:48:27.992350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0316ad00-9955-44e4-ab0c-a8a5ac27e5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:27.993826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 17/31] 10.222.0.36 () {58 vars in 1250 bytes} [Sat Jan 15 15:48:27 2022] GET /compute/v2.1/os-snapshots/08dc929b-f7c1-4152-866b-efc0ad80982d => generated 111 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:48:28.003773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6b2c8fec-b6cd-4d3d-b8f5-c50247a99f75 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f2169e1f820>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:28.138810 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0316ad00-9955-44e4-ab0c-a8a5ac27e5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:28.156905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0316ad00-9955-44e4-ab0c-a8a5ac27e5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1222 microversion: 2.1 time: 0.169856 Jan 15 15:48:28.161316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 15/32] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:27 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:28.181439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-963e1ed7-68bd-453a-896b-ff9c76526709 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f2168282ee0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:28.555957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6b2c8fec-b6cd-4d3d-b8f5-c50247a99f75 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c" status: 202 len: 0 microversion: 2.1 time: 0.557219 Jan 15 15:48:28.560498 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 18/33] 10.222.0.36 () {58 vars in 1247 bytes} [Sat Jan 15 15:48:27 2022] DELETE /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:48:28.565173 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:28.569061 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:28.591759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:28.592234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:28.597851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:28.597851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:28.885684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-963e1ed7-68bd-453a-896b-ff9c76526709 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/038fec90-c286-4da1-9dfc-16831705c9b2" status: 200 len: 351 microversion: 2.1 time: 0.720356 Jan 15 15:48:28.888423 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:28 2022] GET /compute/v2.1/os-volumes/038fec90-c286-4da1-9dfc-16831705c9b2 => generated 351 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:28.897946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e6ea4cd3-7bd8-4288-a59a-d56134bba48d tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f216833fca0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:29.014804 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e6ea4cd3-7bd8-4288-a59a-d56134bba48d tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c" status: 200 len: 345 microversion: 2.1 time: 0.123018 Jan 15 15:48:29.015828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:28 2022] GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:29.022512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-adbdce86-cb58-4737-8404-f131aee29c55 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f21682a6430>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:29.177702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-adbdce86-cb58-4737-8404-f131aee29c55 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.160738 Jan 15 15:48:29.179210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 18/36] 10.222.0.36 () {58 vars in 1133 bytes} [Sat Jan 15 15:48:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:29.192347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1bb21446-8e39-4790-9691-ea958d1413bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:29.193070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1bb21446-8e39-4790-9691-ea958d1413bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:29.427342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:29.435763 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1bb21446-8e39-4790-9691-ea958d1413bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:29.448389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-129f5454-5c1f-4cf3-855a-7870535a0a02 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.885579 Jan 15 15:48:29.450049 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 19/37] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:28 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:29.452772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1bb21446-8e39-4790-9691-ea958d1413bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1222 microversion: 2.1 time: 0.272022 Jan 15 15:48:29.454120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 19/38] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:29 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1222 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:29.456499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-59e98398-4f97-4b0c-b5bc-9d57a1a98986 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f2168272b80>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:29.672335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2131785957", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba917754-41da-43a8-bbd2-12e267fa8e32"}], "security_groups": [{"name": "tempest-securitygroup--2006241206"}], "key_name": "tempest-keypair-283530342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:29.672734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-59e98398-4f97-4b0c-b5bc-9d57a1a98986 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.220695 Jan 15 15:48:29.673963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 20/39] 10.222.0.36 () {58 vars in 1148 bytes} [Sat Jan 15 15:48:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:29.690734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6d2de724-1e49-41ed-8fe7-74c46ea88343 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f21682b9310>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:29.834919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6d2de724-1e49-41ed-8fe7-74c46ea88343 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.149251 Jan 15 15:48:29.836577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 21/40] 10.222.0.36 () {58 vars in 1133 bytes} [Sat Jan 15 15:48:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:29.850274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a3af871b-0f00-416c-b717-a058660dd645 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f2168210820>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:29.921914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] validate_networks() for [('ba917754-41da-43a8-bbd2-12e267fa8e32', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:48:30.015921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a3af871b-0f00-416c-b717-a058660dd645 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.171608 Jan 15 15:48:30.021104 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1166 bytes} [Sat Jan 15 15:48:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:30.031235 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6c86c9d7-4202-41db-9ee1-4dbdb080987c tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f2168210a60>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:30.080446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-6c86c9d7-4202-41db-9ee1-4dbdb080987c tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] HTTP exception thrown: Volume 48931413-30a8-492c-9f6e-c13110e0dd7c could not be found. Jan 15 15:48:30.081084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6c86c9d7-4202-41db-9ee1-4dbdb080987c tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Returning 404 to user: Volume 48931413-30a8-492c-9f6e-c13110e0dd7c could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:48:30.082014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6c86c9d7-4202-41db-9ee1-4dbdb080987c tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c" status: 404 len: 109 microversion: 2.1 time: 0.059224 Jan 15 15:48:30.082628 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:30 2022] GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 15:48:30.091560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c2546d11-b744-4be8-8fa9-b5fd90c9fe93 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f216824f9d0>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:30.253713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c2546d11-b744-4be8-8fa9-b5fd90c9fe93 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.169527 Jan 15 15:48:30.254600 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 24/43] 10.222.0.36 () {58 vars in 1169 bytes} [Sat Jan 15 15:48:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:30.259527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-30d22edb-3621-4743-ad09-cc3957d34c67 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f21682bdca0>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:30.302062 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-30d22edb-3621-4743-ad09-cc3957d34c67 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] HTTP exception thrown: Volume 48931413-30a8-492c-9f6e-c13110e0dd7c could not be found. Jan 15 15:48:30.302672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-30d22edb-3621-4743-ad09-cc3957d34c67 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Returning 404 to user: Volume 48931413-30a8-492c-9f6e-c13110e0dd7c could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:48:30.303504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-30d22edb-3621-4743-ad09-cc3957d34c67 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c" status: 404 len: 109 microversion: 2.1 time: 0.047734 Jan 15 15:48:30.304388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 25/44] 10.222.0.36 () {58 vars in 1247 bytes} [Sat Jan 15 15:48:30 2022] DELETE /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:48:30.310717 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4433eb68-4c70-45be-962e-b49bc4dcb18b tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f2168279160>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:30.425950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4433eb68-4c70-45be-962e-b49bc4dcb18b tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.120093 Jan 15 15:48:30.426883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 26/45] 10.222.0.36 () {58 vars in 1154 bytes} [Sat Jan 15 15:48:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:30.431505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a1e501cc-8a76-4d82-a844-52c056a453f8 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Calling method '.version_select at 0x7f2168210c10>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:30.465990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-a1e501cc-8a76-4d82-a844-52c056a453f8 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] HTTP exception thrown: Volume 48931413-30a8-492c-9f6e-c13110e0dd7c could not be found. Jan 15 15:48:30.466674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a1e501cc-8a76-4d82-a844-52c056a453f8 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] Returning 404 to user: Volume 48931413-30a8-492c-9f6e-c13110e0dd7c could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:48:30.467589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a1e501cc-8a76-4d82-a844-52c056a453f8 tempest-VolumesSnapshotsTestJSON-1002319375 tempest-VolumesSnapshotsTestJSON-1002319375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c" status: 404 len: 109 microversion: 2.1 time: 0.039787 Jan 15 15:48:30.468245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 27/46] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 15:48:30 2022] GET /compute/v2.1/os-volumes/48931413-30a8-492c-9f6e-c13110e0dd7c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:48:30.479477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bdd756d5-8f97-42e6-8011-841169864c86 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f21682b94c0>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:30.655221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bdd756d5-8f97-42e6-8011-841169864c86 tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.185904 Jan 15 15:48:30.662357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 28/47] 10.222.0.36 () {58 vars in 1187 bytes} [Sat Jan 15 15:48:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:30.662357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:30.662759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:30.672944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:30.674391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:30.675547 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:30.676314 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.022431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:31.030444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-279ea3e0-79ab-495e-88a9-cb57075baf5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.372468 Jan 15 15:48:31.035681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 29/48] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:30 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:31.056827 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:31.058380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:31.065375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:31.066152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.067290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:31.067880 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.162474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:48:31.162993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:48:31.163673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:48:31.164279 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:48:31.164785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:48:31.167980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:31.175549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:31.175920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-000ed3bc-cf0e-4862-ab4d-d853406b6f4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.138723 Jan 15 15:48:31.176942 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 30/49] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:31 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:31.178140 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.179362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:31.179967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.187447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-435be969-655a-4c7d-a614-7a0da942433b tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] Calling method '.version_select at 0x7f2168b71670>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:31.202709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:48:31.207345 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for user 36b1f031a12243b59ef309631e015afb and project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:48:31.222931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:48:31.225198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:48:31.281574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-435be969-655a-4c7d-a614-7a0da942433b tempest-VolumesTestJSON-7254203 tempest-VolumesTestJSON-7254203-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.103330 Jan 15 15:48:31.282346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 31/50] 10.222.0.36 () {58 vars in 1154 bytes} [Sat Jan 15 15:48:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:31.347172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b17c16ba-ebac-4142-9909-048645df2f46 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.695818 Jan 15 15:48:31.347824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 20/51] 10.222.0.36 () {62 vars in 1187 bytes} [Sat Jan 15 15:48:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 15 15:48:31.358024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9409ce4e-2666-4038-bda5-61be898fd312 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:31.358645 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9409ce4e-2666-4038-bda5-61be898fd312 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:31.430114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9409ce4e-2666-4038-bda5-61be898fd312 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:31.455546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9409ce4e-2666-4038-bda5-61be898fd312 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:31.461544 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9409ce4e-2666-4038-bda5-61be898fd312 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:31.465980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9409ce4e-2666-4038-bda5-61be898fd312 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1281 microversion: 2.20 time: 0.111842 Jan 15 15:48:31.469605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 32/52] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:31 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 15:48:31.880887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-f9f0fd69-e37e-46b4-86da-769439cf6221 req-35c226f2-28ff-4a66-a3c5-0f725bb0aa8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "456f3da5-cdea-4d59-8273-bb6954e3e809", "tag": "bb3f643d-10ce-4fe2-a626-ca1acff6ab05"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:31.890242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:48:31.890242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:48:31.905053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-f9f0fd69-e37e-46b4-86da-769439cf6221 req-35c226f2-28ff-4a66-a3c5-0f725bb0aa8f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:31.905589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-f9f0fd69-e37e-46b4-86da-769439cf6221 req-35c226f2-28ff-4a66-a3c5-0f725bb0aa8f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.926624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-f9f0fd69-e37e-46b4-86da-769439cf6221 req-35c226f2-28ff-4a66-a3c5-0f725bb0aa8f service nova] Creating event network-changed:bb3f643d-10ce-4fe2-a626-ca1acff6ab05 for instance 456f3da5-cdea-4d59-8273-bb6954e3e809 on hv-cinder-82481 Jan 15 15:48:31.927281 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-f9f0fd69-e37e-46b4-86da-769439cf6221 req-35c226f2-28ff-4a66-a3c5-0f725bb0aa8f service nova] Acquired lock "compute-rpcapi-router" {{(pid=123220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 15:48:31.928531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae267631-221d-48d4-bf5f-f4f63a0db2b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:31.929048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae267631-221d-48d4-bf5f-f4f63a0db2b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.929938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae267631-221d-48d4-bf5f-f4f63a0db2b1 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:31.930507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae267631-221d-48d4-bf5f-f4f63a0db2b1 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:31.941603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.compute.rpcapi [None req-ae267631-221d-48d4-bf5f-f4f63a0db2b1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 15 15:48:31.942511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae267631-221d-48d4-bf5f-f4f63a0db2b1 None None] Releasing lock "compute-rpcapi-router" {{(pid=123220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 15:48:31.969857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ae267631-221d-48d4-bf5f-f4f63a0db2b1 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181858 Jan 15 15:48:31.970504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 21/53] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:32.051925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:32.052579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:32.069080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:32.069535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:32.070503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:32.071086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:32.193929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:32.194647 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:32.212526 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:32.213383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:32.214982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:32.215602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:32.290008 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:32.299193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0d2a4db8-1a0a-435e-a8de-03ca2f8b62ac tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.251162 Jan 15 15:48:32.300115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 33/54] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:32 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:32.332733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:32.341474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8a7ab655-437d-4820-9d53-36b61c014582 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.151398 Jan 15 15:48:32.342365 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 22/55] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:32 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:32.488825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b79aa4f9-b3a1-488f-a48f-ea5701e7e1b9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:32.489442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b79aa4f9-b3a1-488f-a48f-ea5701e7e1b9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:32.541907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b79aa4f9-b3a1-488f-a48f-ea5701e7e1b9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:32.549799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b79aa4f9-b3a1-488f-a48f-ea5701e7e1b9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:32.551312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b79aa4f9-b3a1-488f-a48f-ea5701e7e1b9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:32.552462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b79aa4f9-b3a1-488f-a48f-ea5701e7e1b9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1281 microversion: 2.20 time: 0.067275 Jan 15 15:48:32.553007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 34/56] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:32 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 15:48:33.316051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:33.316744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:33.322567 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:33.323033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:33.323870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:33.324373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:33.360172 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:33.361657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:33.368004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:33.371212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:33.371212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:33.371212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:33.465038 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:33.474927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b28ce08c-d6e3-43d7-9424-f4bb91fd80cd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.119779 Jan 15 15:48:33.475808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 35/57] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:33 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:33.548705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:33.556045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d0859605-7a02-4059-92b8-0010c7a2d252 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.243734 Jan 15 15:48:33.556651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 23/58] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:33 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:33.571033 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:33.571919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:33.578434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:33.580853 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:33.580853 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:33.580853 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:33.642631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:33.657110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:33.659347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:33.659723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9b09003d-28c5-40c8-ae26-8fdd6cd0e131 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.092389 Jan 15 15:48:33.660411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 36/59] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:33 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:34.491604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:34.492320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:34.499265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:34.499768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:34.500610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:34.501051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:34.560310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:34.567930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a7db6117-3cfa-4bcd-a3a4-4e66b702f823 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.079618 Jan 15 15:48:34.568525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 24/60] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:34 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:34.574205 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:34.574828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:34.581050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:34.581583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:34.582532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:34.583203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:34.679589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:34.680227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:34.688211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:34.688926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:34.689815 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:34.690277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:34.792983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:34.802003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:34.803884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:34.805329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-523101ee-338a-47fc-b609-6c5b3fc0c076 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.129330 Jan 15 15:48:34.806170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 25/61] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:34 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:34.820824 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:34.836378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d63d2ca-158d-4ec0-bef6-121be34df0ee tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.267152 Jan 15 15:48:34.839643 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 37/62] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:34 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:35.585745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:35.586450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:35.596400 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:35.596864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:35.597690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:35.598142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:35.699561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:35.712802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-eced9bf2-9b4f-48a6-9792-163f71ba24e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.126478 Jan 15 15:48:35.712802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 26/63] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:35 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:35.826657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:35.827476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:35.835642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:35.836646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:35.837692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:35.838503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:35.855600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:35.856921 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:35.865649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:35.866288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:35.868907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:35.871289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:35.938956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:35.947249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:36.132691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:36.132691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-33dd97ba-c2fe-46ca-b4df-fc8827e781c1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.128467 Jan 15 15:48:36.132691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 38/64] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:35 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:36.132917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:36.132917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d0ffae65-99bd-4c55-9b90-c62ee98954e0 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.196130 Jan 15 15:48:36.132917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 27/65] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:35 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:36.725115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:36.726228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:36.733083 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:36.733699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:36.734619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:36.735169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:36.799664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:36.807281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f2c536ed-3eb7-4696-b994-5f71e69ec202 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.085951 Jan 15 15:48:36.808550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 39/66] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:36 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:37.153220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:37.170154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:37.170475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:37.170475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:37.170981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:37.170981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:37.170981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:37.170981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:37.172627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:37.175738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:37.176835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:37.177363 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:37.325048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:37.333164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:37.334752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:37.335897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4e140bc8-2969-4451-aa01-1016359221a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.179689 Jan 15 15:48:37.336492 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 40/67] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:37 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 15:48:37.404579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:37.413298 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c6f6a194-5624-4f9c-89fa-ae4561c0c0ba tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.264397 Jan 15 15:48:37.414810 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 28/68] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:37 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:37.825516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:37.828355 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:37.842154 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:37.852334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:37.852334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:37.852334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:37.917286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:37.927503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6e9281f4-2275-45d7-947c-99b43eba0ff4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.105850 Jan 15 15:48:37.934635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 41/69] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:37 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:38.354805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:38.355745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:38.361822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:38.362336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:38.363165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:38.363982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:38.427461 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:38.434445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:38.436095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:38.441077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:38.451616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:38.451616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:38.451616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6a3161bf-546e-45be-9a62-de8089c339c8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.096897 Jan 15 15:48:38.451880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 29/70] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:38 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:38.452217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:38.453259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:38.461615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:38.601771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:38.609454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8b01bb2e-d109-49df-98be-776b08fab669 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.179408 Jan 15 15:48:38.610029 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 42/71] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:38 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:38.953266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:38.953888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:38.959836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:38.960328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:38.961168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:38.961616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:39.027852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:39.035317 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-def768d3-b46c-4403-866e-da9e9ca42f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.086820 Jan 15 15:48:39.035970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 30/72] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:38 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:39.468998 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:39.469651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:39.475758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:39.476249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:39.477055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:39.477497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:39.585022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:39.596027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:39.597615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:39.599483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4b87b39f-aedf-414d-8550-4767bce40d44 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.133931 Jan 15 15:48:39.599985 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 43/73] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:39 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:39.626706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:39.627325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:39.633274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:39.633725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:39.634516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:39.634956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:39.929993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:39.939648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8a2b8c00-6c22-46eb-8eeb-1554dd400156 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.314773 Jan 15 15:48:39.939648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 31/74] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:39 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:40.053137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:40.053840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:40.060392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:40.060854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:40.061632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:40.062073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:40.119294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:40.127112 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e492aa76-478d-4e2f-973b-9a4c79617a6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.077590 Jan 15 15:48:40.127680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 44/75] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:40 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:40.618058 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:40.618745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:40.624969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:40.625423 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:40.626231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:40.626673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:40.684954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:40.692495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:40.694023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:40.695121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c7c1e2b2-4f7b-4c99-9872-b0e646418011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.081332 Jan 15 15:48:40.695669 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 32/76] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:40 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:40.959024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:40.960181 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:40.966602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:40.967057 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:40.967908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:40.968374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:41.101881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:41.109193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aa804cd7-b5c1-4c57-9539-399ad5149da5 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.157864 Jan 15 15:48:41.109758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 45/77] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:40 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:41.144447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:41.145066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:41.150893 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:41.151349 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:41.152126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:41.152585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:41.211689 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:41.220585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-76593dd9-7c3b-441c-b376-409fea5448f3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.080225 Jan 15 15:48:41.221180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 33/78] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:41 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:41.713059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:41.713677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:41.720540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:41.720943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:41.721722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:41.722164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:41.784061 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:41.791800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:41.793586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:41.794682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c2513a89-0a58-4775-867e-554176b9fec8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.085346 Jan 15 15:48:41.795247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 46/79] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:41 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 15:48:42.125033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:42.125645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:42.131362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:42.133328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:42.133328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:42.133328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:42.238283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:42.238905 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:42.244818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:42.245445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:42.246336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:42.246783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:42.268721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:42.277620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-96f0805c-df40-4417-9fa5-0af8d2d74d03 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.155256 Jan 15 15:48:42.278451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 34/80] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:42 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:42.309558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:42.317295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b6ab97a1-18b8-4452-8486-d35afd785147 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1226 microversion: 2.1 time: 0.082824 Jan 15 15:48:42.317975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 47/81] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:42 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:42.814232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:42.814912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:42.821171 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:42.821628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:42.822448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:42.825412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:42.935254 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:42.944755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:42.946408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:42.947742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d0b353c4-ee34-4dbe-9d7a-b7a40b9f54c5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1285 microversion: 2.20 time: 0.137219 Jan 15 15:48:42.948702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 35/82] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:42 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:43.294621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:43.295790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:43.302647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:43.303415 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:43.304567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:43.305144 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:43.339028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:43.340459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:43.347583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:43.350932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:43.350932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:43.350932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:43.451213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:43.458561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-67e705a9-1984-419e-9394-c488b3b88be3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1274 microversion: 2.1 time: 0.125236 Jan 15 15:48:43.459133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 36/83] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:43 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:43.757581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:43.765792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f424d62c-e170-4732-ae0f-1138e7a92106 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.474946 Jan 15 15:48:43.771684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 48/84] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:43 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:43.973260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:43.984724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:43.993643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:43.995402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:43.997408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:43.998011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:44.165896 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:44.181233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:44.184975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:44.186505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-18e6fb00-f5d3-45d1-b352-dd143164944f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1341 microversion: 2.20 time: 0.223504 Jan 15 15:48:44.200485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 37/85] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:43 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:44.475529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:44.476781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:44.482899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:44.483356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:44.484201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:44.484646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:44.566212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:44.579860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1adf8f53-523d-4f9f-ae08-be31cd91244b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1280 microversion: 2.1 time: 0.105859 Jan 15 15:48:44.580513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 49/86] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:44 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1280 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:44.784585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:44.785449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:44.793647 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:44.794229 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:44.805707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:44.805707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:45.072026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:45.077930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a14881b9-a983-4b83-b91d-a7c7f1ae8452 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.297859 Jan 15 15:48:45.079267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 38/87] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:44 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:45.204531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:45.206115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:45.212023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:45.212934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:45.213726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:45.214320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:45.320276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:45.342262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-777ad02b-02cd-485f-9d65-a7e5b2f14465 req-cad7cfe2-d718-47d3-87e2-418797e1395a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9275a1-4d53-4571-be72-2b4524364e4a", "tag": "b4c26bef-3b98-4971-99aa-f32d1efad8ab"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:45.348928 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:48:45.348928 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:48:45.366707 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:45.378448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:45.378448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-60dbe61f-200d-4738-b7be-769e34d0d75c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1339 microversion: 2.20 time: 0.172158 Jan 15 15:48:45.378448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 50/88] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:45 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1339 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:45.379284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-777ad02b-02cd-485f-9d65-a7e5b2f14465 req-cad7cfe2-d718-47d3-87e2-418797e1395a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:45.379742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-777ad02b-02cd-485f-9d65-a7e5b2f14465 req-cad7cfe2-d718-47d3-87e2-418797e1395a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:45.403036 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-777ad02b-02cd-485f-9d65-a7e5b2f14465 req-cad7cfe2-d718-47d3-87e2-418797e1395a service nova] Creating event network-changed:b4c26bef-3b98-4971-99aa-f32d1efad8ab for instance ba9275a1-4d53-4571-be72-2b4524364e4a on hv-cinder-82481 Jan 15 15:48:45.409126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-777ad02b-02cd-485f-9d65-a7e5b2f14465 req-cad7cfe2-d718-47d3-87e2-418797e1395a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073015 Jan 15 15:48:45.415358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 39/89] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:45.600182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:45.602811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:45.625407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:45.626169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:45.627573 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:45.628193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:45.977897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:45.987553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8873faee-0bd7-408c-b939-cfe3381c6512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.393520 Jan 15 15:48:45.992108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 51/90] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:45 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:46.100339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:46.101683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:46.109731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:46.110991 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:46.112095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:46.112577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:46.402652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:46.403286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:46.414257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:46.427462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-03d8abc2-b19b-4359-b794-74b977935dbd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.331290 Jan 15 15:48:46.428172 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:46.429469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:46.430574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 40/91] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:46 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:46.430771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:46.431249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:46.907942 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:46.919549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:46.922566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:46.924877 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9d8c326d-b2cb-4241-bd9f-f66dad4eaf83 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.529002 Jan 15 15:48:46.925795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 52/92] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:46 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:47.010006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:47.011354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:47.018312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:47.020250 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:47.021915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:47.023354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:47.199595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:47.207193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f50afa43-99d5-4419-b450-337836d17a23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.202163 Jan 15 15:48:47.208238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 41/93] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:47 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:47.446835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:47.447561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:47.453684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:47.454228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:47.455089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:47.455604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:47.631289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:47.640937 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0d19409a-1cb3-4c4b-b9cb-1f0b1df73e01 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.197673 Jan 15 15:48:47.641535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 53/94] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:47 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:47.942894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:47.955794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:47.962373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:47.963045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:47.964672 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:47.965467 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.126535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-0d3c4086-c1c3-42f7-9480-ac26ff1cef0b req-64cf3cb2-77a2-4281-8f8e-476aa8e50581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62b0ad3-733e-4543-8395-a9ebb0de6702", "tag": "c57c6f6f-54d0-451c-936b-073bd33f289b"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:48.128813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:48:48.128813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:48:48.144056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-0d3c4086-c1c3-42f7-9480-ac26ff1cef0b req-64cf3cb2-77a2-4281-8f8e-476aa8e50581 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:48.144527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-0d3c4086-c1c3-42f7-9480-ac26ff1cef0b req-64cf3cb2-77a2-4281-8f8e-476aa8e50581 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.165090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-0d3c4086-c1c3-42f7-9480-ac26ff1cef0b req-64cf3cb2-77a2-4281-8f8e-476aa8e50581 service nova] Creating event network-changed:c57c6f6f-54d0-451c-936b-073bd33f289b for instance a62b0ad3-733e-4543-8395-a9ebb0de6702 on hv-cinder-82481 Jan 15 15:48:48.165893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-0d3c4086-c1c3-42f7-9480-ac26ff1cef0b req-64cf3cb2-77a2-4281-8f8e-476aa8e50581 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 15:48:48.167562 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-52549d39-c811-439d-990a-1a9161c053d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:48.168002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-52549d39-c811-439d-990a-1a9161c053d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.169680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-52549d39-c811-439d-990a-1a9161c053d4 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:48.170269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-52549d39-c811-439d-990a-1a9161c053d4 None None] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.185611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.compute.rpcapi [None req-52549d39-c811-439d-990a-1a9161c053d4 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 15 15:48:48.186584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-52549d39-c811-439d-990a-1a9161c053d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 15:48:48.204348 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:48.207508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-52549d39-c811-439d-990a-1a9161c053d4 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169629 Jan 15 15:48:48.208227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 54/95] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:48:48.213624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:48.215859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:48.217018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-df1b8410-4bc5-4589-9183-c93808b9b011 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.278066 Jan 15 15:48:48.217580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 42/96] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:47 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:48.224711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:48.225500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:48.231840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:48.232474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.233273 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:48.233722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.375380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:48.382762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e5789bd4-3c18-4949-8205-a6887ba5555d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.161910 Jan 15 15:48:48.383321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 55/97] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:48 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:48.658946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:48.659572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:48.665540 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:48.665993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.666862 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:48.667308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:48.824944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:48.833141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-70c97973-f103-4118-bfa9-4e4a9bb29b88 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.177969 Jan 15 15:48:48.833715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 43/98] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:48 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:49.237508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:49.238106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:49.246569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:49.247353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:49.248186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:49.248635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:49.402777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:49.403398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:49.414925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:49.415978 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:49.418128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:49.418852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:49.424069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:49.432421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:49.434242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:49.435713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b172d820-e82e-418a-9c06-dcf39f7b7811 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.202691 Jan 15 15:48:49.436504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 56/99] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:49 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:49.586454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:49.595033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-82e87ca5-b946-4b02-9df7-9e8796bd648e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.198161 Jan 15 15:48:49.596390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 44/100] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:49 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:49.856230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:49.856230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:49.856230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:49.856569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:49.857116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:49.857557 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:50.016280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:50.030362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-20a0eb77-e91e-404e-b509-026652b08e28 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.184555 Jan 15 15:48:50.040920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 57/101] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:49 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:50.223641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-0502f876-f465-4c65-8aed-d688fa8f7f4c req-3768a967-0d7b-4d36-84e6-ca11ebcae3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a436d761-1adc-477e-b18c-cf92ca8a7acc", "tag": "300c880f-2fc9-4f7e-9677-0ec892ca7a68"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:48:50.225333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:48:50.225333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:48:50.231951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-0502f876-f465-4c65-8aed-d688fa8f7f4c req-3768a967-0d7b-4d36-84e6-ca11ebcae3cc service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:50.232426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-0502f876-f465-4c65-8aed-d688fa8f7f4c req-3768a967-0d7b-4d36-84e6-ca11ebcae3cc service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:50.242633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-0502f876-f465-4c65-8aed-d688fa8f7f4c req-3768a967-0d7b-4d36-84e6-ca11ebcae3cc service nova] Creating event network-changed:300c880f-2fc9-4f7e-9677-0ec892ca7a68 for instance a436d761-1adc-477e-b18c-cf92ca8a7acc on hv-cinder-82481 Jan 15 15:48:50.247916 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-0502f876-f465-4c65-8aed-d688fa8f7f4c req-3768a967-0d7b-4d36-84e6-ca11ebcae3cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027878 Jan 15 15:48:50.248540 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 45/102] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:48:50.454304 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:50.454926 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:50.460851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:50.461307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:50.462093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:50.462554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:50.600401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:50.608609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:50.610589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:50.611733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-33e3f4ae-cfa2-49d2-8a48-54d4d2bad67c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.161129 Jan 15 15:48:50.612332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 58/103] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:50 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:50.615687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:50.617038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:50.624656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:50.625396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:50.626408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:50.626943 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:50.762199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:50.769933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4b5cfa58-1b38-43b6-a9d4-b01f167e6e40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.158840 Jan 15 15:48:50.770603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 46/104] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:50 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:51.046960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:51.049185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:51.055140 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:51.055775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:51.056735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:51.059640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:51.272292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:51.280331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-19351657-587c-4a24-aadc-e3b8182922cd tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.236816 Jan 15 15:48:51.280905 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 59/105] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:51 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:51.629950 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:51.630555 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:51.637737 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:51.638188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:51.638974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:51.644398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:51.786758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:51.788128 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:51.795314 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:51.796025 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:51.796873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:51.797323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:51.800552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:51.809615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:51.811679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:51.813175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e83130f5-0022-4ab3-b87c-3f2d30f00169 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.187356 Jan 15 15:48:51.825596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 47/106] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:51 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:51.956333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:51.964431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-81033494-06f7-44ee-a3d4-1ba069219035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.181196 Jan 15 15:48:51.976470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 60/107] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:51 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:52.297189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:52.298351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:52.304988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:52.305603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:52.306563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:52.307141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:52.488629 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:52.497014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-07bb25ca-a1ca-4779-a8fc-7f53e3357cbe tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.203771 Jan 15 15:48:52.497592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 48/108] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:52 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:52.831251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:52.831865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:52.837702 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:52.838161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:52.839138 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:52.839767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:52.974094 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:52.982735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:52.983809 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:52.984393 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:52.984517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:52.985710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e2c3dda1-bcdf-478b-a5ca-ba16cc186ae5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.158203 Jan 15 15:48:52.986513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 61/109] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:52 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:52.990258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:53.004965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:53.004965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:53.004965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:53.121264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:53.128495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7d7d9590-73ef-4ba2-8db8-7a7d0807c9d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.148251 Jan 15 15:48:53.129069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 49/110] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:52 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:53.514346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:53.515012 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:53.520787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:53.521240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:53.522023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:53.522461 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:53.651618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:53.658973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d2cf0520-c733-40bf-a648-ad0600059d8f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.149036 Jan 15 15:48:53.659537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 62/111] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:53 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:54.004067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:54.004712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:54.010617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:54.011188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:54.011980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:54.012457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:54.145890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:54.146025 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:54.146636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:54.152565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:54.153015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:54.153837 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:54.154232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:54.154339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:54.155755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:54.156911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-865f41e5-d14d-4f15-9ff8-03b8f88bb93e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.156690 Jan 15 15:48:54.157474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 50/112] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:53 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:54.285460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:54.293728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-85e3cafd-a0e1-48ca-9f32-0da446dc6ca3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.151461 Jan 15 15:48:54.294301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 63/113] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:54 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:54.675681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:54.676654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:54.683750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:54.684231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:54.685017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:54.685459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:54.820811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:54.829209 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0c25cbfa-bafb-46da-b5c0-e7166659de7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.157343 Jan 15 15:48:54.829971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 51/114] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:54 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:55.352261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:55.352261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:55.352261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:55.352261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:55.353348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:55.353348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:55.353505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:55.353505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:55.355102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:55.355219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:55.355219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:55.355219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:55.355219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:55.355627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:55.355627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:55.355627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4273e31d-e19b-4332-b4c7-87b6fce980e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.156406 Jan 15 15:48:55.355880 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 64/115] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:55 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:55.474697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:55.474697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9c60204d-8b1c-4b9d-8065-e6e5d57fcc71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.155605 Jan 15 15:48:55.474697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 52/116] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:55 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:55.845803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:55.846539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:55.852406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:55.852937 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:55.853809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:55.854619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:56.033349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:56.046580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d549de87-a8fe-4030-b22e-015b524bff65 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.204345 Jan 15 15:48:56.050409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 65/117] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:55 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:56.359431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:56.359431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:56.364856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:56.365318 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:56.366113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:56.366786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:56.491477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:56.492106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:56.498622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:56.499081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:56.499879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:56.500367 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:56.515110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:56.523750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:56.527708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:56.529564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-78386ae4-7806-4710-a358-82ca9c8a638f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.176306 Jan 15 15:48:56.541468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 53/118] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:56 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:56.648658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:56.656299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-03fcbfce-2b43-435a-912f-5eb18235bdde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.169052 Jan 15 15:48:56.656870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 66/119] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:56 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:57.067592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:57.068883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:57.080575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:57.080575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:57.081252 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:57.081959 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:57.238369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:57.248594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2261d19a-4b72-4887-8e36-2c089ce3874d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.186885 Jan 15 15:48:57.257990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 54/120] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:57 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:57.548246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:57.549392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:57.554716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:57.555171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:57.555957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:57.556424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:57.673699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:57.675610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:57.684365 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:57.685053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:57.686325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:57.687270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:57.714584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:57.723007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:57.724880 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:57.726262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-529b4b89-e4e7-468d-8e1e-8b6492f08ee3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.182067 Jan 15 15:48:57.727325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 67/121] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:57 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:57.830941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:57.842252 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dff13be0-4b91-47b3-87ab-bfb966555d00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.172491 Jan 15 15:48:57.846112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 55/122] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:57 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:58.264367 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:58.264975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:58.271150 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:58.271966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:58.272885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:58.273428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:58.408027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:58.415175 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bb4af3c3-4674-4b67-8aae-9c16b2b83f56 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.155008 Jan 15 15:48:58.415772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 68/123] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:58 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:58.744205 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:58.746016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:58.751722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:58.752278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:58.752960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:58.753558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:58.859067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:58.859682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:58.865416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:58.865865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:58.866647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:58.867085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:58.884227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:58.892162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:58.893839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:58.895145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-38d7668c-fb35-4e8f-8b96-b5a458cac253 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.154486 Jan 15 15:48:58.895899 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 56/124] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:58 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:48:59.011930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:59.019812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-33a0ee2a-e3ba-4b56-8ffc-2f8f2b42cbdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.164308 Jan 15 15:48:59.029695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 69/125] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:58 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:48:59.433103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:59.433731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:59.443667 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:59.443917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:59.444813 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:59.445249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:59.610042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:48:59.619078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f1170e7c-0820-42d4-b130-92fb6f062f79 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.189774 Jan 15 15:48:59.620442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 57/126] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:48:59 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:48:59.913519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:48:59.914135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:48:59.920486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:59.920936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:48:59.921789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:48:59.922233 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:00.038888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:00.041000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:00.049559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:00.050758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:00.051750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:00.052392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:00.056660 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:00.066051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:00.067566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:00.069123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8d21dc73-3460-4e6b-943e-fd599d2952b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.159217 Jan 15 15:49:00.069745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 70/127] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:48:59 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:00.188723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:00.196549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-930383b0-47bd-4cc7-892e-147977f3a016 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.162944 Jan 15 15:49:00.197423 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 58/128] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:00 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:00.636999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:00.637681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:00.643473 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:00.643927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:00.644767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:00.645214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:00.776119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:00.783589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9a43ceeb-c5cc-496d-b661-95ed281f4bed tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.151005 Jan 15 15:49:00.784334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 71/129] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:00 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:01.087237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:01.087840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:01.094355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:01.094796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:01.095564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:01.096001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:01.213554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:01.214354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:01.220476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:01.221027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:01.221957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:01.222408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:01.233216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:01.243620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:01.245480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:01.247021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dc8ec9bc-66eb-4bec-9129-0b2de70d43f2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.163353 Jan 15 15:49:01.247537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 59/130] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:01 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:01.360353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:01.367619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cf1f5517-19bd-424a-aff7-77a92e603c19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.158065 Jan 15 15:49:01.368201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 72/131] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:01 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:01.804524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:01.805143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:01.811538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:01.811998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:01.813035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:01.813722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:01.943366 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:01.951449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6a485b68-d3ac-4013-8c88-7aab5b8370e6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.150425 Jan 15 15:49:01.952470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 60/132] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:01 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:02.264721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:02.266128 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:02.272124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:02.272600 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:02.273378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:02.273807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:02.398307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-de5486cf-95d8-4a23-8007-e9234ece8177 req-7284cdc0-af3f-4926-ac51-45f84d15c23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456f3da5-cdea-4d59-8273-bb6954e3e809", "name": "network-vif-plugged", "status": "completed", "tag": "bb3f643d-10ce-4fe2-a626-ca1acff6ab05"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:02.400113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:02.400113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:49:02.409696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-de5486cf-95d8-4a23-8007-e9234ece8177 req-7284cdc0-af3f-4926-ac51-45f84d15c23c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:02.410499 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-de5486cf-95d8-4a23-8007-e9234ece8177 req-7284cdc0-af3f-4926-ac51-45f84d15c23c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:02.425729 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-de5486cf-95d8-4a23-8007-e9234ece8177 req-7284cdc0-af3f-4926-ac51-45f84d15c23c service nova] Creating event network-vif-plugged:bb3f643d-10ce-4fe2-a626-ca1acff6ab05 for instance 456f3da5-cdea-4d59-8273-bb6954e3e809 on hv-cinder-82481 Jan 15 15:49:02.431126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-de5486cf-95d8-4a23-8007-e9234ece8177 req-7284cdc0-af3f-4926-ac51-45f84d15c23c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109795 Jan 15 15:49:02.432042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 61/133] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:49:02.438472 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:02.439326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:02.443244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:02.447062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:02.447062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:02.448118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:02.448653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:02.451864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:02.453586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:02.454994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c42af00d-869e-427c-bc7d-c7d6c5216414 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.193912 Jan 15 15:49:02.455553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 73/134] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:02 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:02.585097 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:02.593806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4f0ab0aa-4ae5-48fa-a012-d582b9fe756d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.160150 Jan 15 15:49:02.594385 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 62/135] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:02 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:02.968584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:02.969235 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:02.977961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:02.978507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:02.979907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:02.980439 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:03.111899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:03.119225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-14602e0a-6757-464d-ab6a-3c04ab8ffb20 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.154249 Jan 15 15:49:03.120526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 74/136] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:02 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:03.472794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:03.473417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:03.480279 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:03.480758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:03.487794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:03.487794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:03.610934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:03.611607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:03.615517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:03.618144 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:03.618610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:03.622346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:03.622346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:03.624827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:03.626443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:03.627679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-43fd47e5-1a5d-447c-99cb-a006e9ea739e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.158542 Jan 15 15:49:03.632235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 63/137] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:03 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:03.758786 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:03.766685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3bd8b923-21a7-4a07-ae3c-2092b1f53f63 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.159445 Jan 15 15:49:03.767250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 75/138] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:03 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:04.137789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:04.138396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:04.144681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:04.145012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:04.146226 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:04.146789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:04.303170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:04.310534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4a214204-eebb-4fef-a6eb-22f93f8ebf34 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.177437 Jan 15 15:49:04.312925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 64/139] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:04 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:04.646166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:04.646778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:04.654007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:04.658106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:04.658106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:04.658106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:04.783977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:04.786397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:04.799069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:04.803384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:04.803843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:04.804682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:04.805124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:04.807525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:04.809258 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:04.810417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-689f75eb-2eff-425c-b58a-a23ca6c74bcf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.168435 Jan 15 15:49:04.811359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 76/140] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:04 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:04.944557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:04.952078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f9b1bda3-fcfa-462d-9fb6-f3f0a29ae056 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.171806 Jan 15 15:49:04.952942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 65/141] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:04 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:05.329219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:05.330044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:05.337254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:05.337749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:05.339166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:05.339564 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:05.485147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:05.493329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d73b567-4e0a-48be-8dbb-5c6473336c7a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.170496 Jan 15 15:49:05.520526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 77/142] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:05 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:05.833165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:05.833772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:05.840326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:05.840775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:05.841545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:05.841975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:05.969691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:05.970331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:05.981937 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:05.982402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:05.983198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:05.983637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:05.992342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:06.017048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:06.019873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:06.024627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6e7a38c0-72bb-49fd-885a-746153c9b39f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.194180 Jan 15 15:49:06.039445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 66/143] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:05 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:06.174727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-6cdcd56d-0380-4a60-857d-d0679f2d4ddc req-3dbb5216-00a3-4115-9f43-b45b30cf286e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9275a1-4d53-4571-be72-2b4524364e4a", "name": "network-vif-plugged", "status": "completed", "tag": "b4c26bef-3b98-4971-99aa-f32d1efad8ab"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:06.176437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:06.176437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:49:06.202822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:06.209849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6cdcd56d-0380-4a60-857d-d0679f2d4ddc req-3dbb5216-00a3-4115-9f43-b45b30cf286e service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:06.210293 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6cdcd56d-0380-4a60-857d-d0679f2d4ddc req-3dbb5216-00a3-4115-9f43-b45b30cf286e service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:06.218204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-144fd6d5-de09-4fef-a59d-0f0ad7a74f56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.251990 Jan 15 15:49:06.219713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 78/144] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:05 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:06.237857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-6cdcd56d-0380-4a60-857d-d0679f2d4ddc req-3dbb5216-00a3-4115-9f43-b45b30cf286e service nova] Creating event network-vif-plugged:b4c26bef-3b98-4971-99aa-f32d1efad8ab for instance ba9275a1-4d53-4571-be72-2b4524364e4a on hv-cinder-82481 Jan 15 15:49:06.243693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-6cdcd56d-0380-4a60-857d-d0679f2d4ddc req-3dbb5216-00a3-4115-9f43-b45b30cf286e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072728 Jan 15 15:49:06.249288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 67/145] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:49:06.512119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:06.513036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:06.519205 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:06.519736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:06.520699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:06.521522 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:06.667180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:06.675228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-84ac9f5e-a31a-4f18-9ce0-83e5e974a345 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1315 microversion: 2.1 time: 0.168718 Jan 15 15:49:06.675869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 79/146] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:06 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:07.046707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:07.048926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:07.054777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:07.055219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:07.055989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:07.056503 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:07.189783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:07.198102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:07.199969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:07.201094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0ad344fc-e766-49f7-b3c8-995ce7c20e31 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.159258 Jan 15 15:49:07.201653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 68/147] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:07 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:07.236416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:07.239496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:07.243092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:07.243542 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:07.244885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:07.245469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:07.389869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:07.397101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b6b7a6a0-dc12-47ca-8b26-c0f97e7487be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.164316 Jan 15 15:49:07.397667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 80/148] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:07 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:07.691744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:07.692380 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:07.698451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:07.698889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:07.699660 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:07.700091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:07.828383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:07.835700 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-87e5c052-d9bf-4be6-a704-ed222309e849 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1502 microversion: 2.1 time: 0.147668 Jan 15 15:49:07.836287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 69/149] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:07 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:08.218857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:08.219558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:08.225436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:08.225931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:08.226711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:08.227151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:08.279037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-3349841b-ab40-420e-84eb-4e892802f618 req-1dc0d426-1729-415f-a79f-5e4002699296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62b0ad3-733e-4543-8395-a9ebb0de6702", "name": "network-vif-plugged", "status": "completed", "tag": "c57c6f6f-54d0-451c-936b-073bd33f289b"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:08.282422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:08.282422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:49:08.290838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-3349841b-ab40-420e-84eb-4e892802f618 req-1dc0d426-1729-415f-a79f-5e4002699296 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:08.291844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-3349841b-ab40-420e-84eb-4e892802f618 req-1dc0d426-1729-415f-a79f-5e4002699296 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:08.304960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-3349841b-ab40-420e-84eb-4e892802f618 req-1dc0d426-1729-415f-a79f-5e4002699296 service nova] Creating event network-vif-plugged:c57c6f6f-54d0-451c-936b-073bd33f289b for instance a62b0ad3-733e-4543-8395-a9ebb0de6702 on hv-cinder-82481 Jan 15 15:49:08.311006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-3349841b-ab40-420e-84eb-4e892802f618 req-1dc0d426-1729-415f-a79f-5e4002699296 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041670 Jan 15 15:49:08.311682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 70/150] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:49:08.383823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:08.393504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:08.395699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:08.396716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-28a293b7-2e85-44fe-bd2f-bebfa4dcf34c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.181632 Jan 15 15:49:08.403078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 81/151] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:08 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:08.414839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:08.415715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:08.423443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:08.426122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:08.426122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:08.426122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:08.573428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:08.580936 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-65161949-fc36-495a-8beb-b292967484ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.170583 Jan 15 15:49:08.590468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 71/152] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:08 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:09.420903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:09.421509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:09.427881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:09.428368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:09.429146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:09.429576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:09.559973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:09.567987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:09.569509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:09.570605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-67e5f9cd-e2a5-4d8b-a21f-5a9c8c924d8b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.153389 Jan 15 15:49:09.571158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 82/153] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:09 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:09.597536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:09.598145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:09.604779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:09.605597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:09.606395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:09.606832 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:09.735382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:09.742459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3b964e8c-77c2-4041-bc91-be663eaccaf3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.148524 Jan 15 15:49:09.743023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 72/154] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:09 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:10.326568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-64f6e170-dd8c-49db-a4d1-017440a250c6 req-2d82a87a-2609-42fb-8212-b7d0e9b05464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a436d761-1adc-477e-b18c-cf92ca8a7acc", "name": "network-vif-plugged", "status": "completed", "tag": "300c880f-2fc9-4f7e-9677-0ec892ca7a68"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:10.328284 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:10.328284 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:49:10.335846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-64f6e170-dd8c-49db-a4d1-017440a250c6 req-2d82a87a-2609-42fb-8212-b7d0e9b05464 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:10.336322 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-64f6e170-dd8c-49db-a4d1-017440a250c6 req-2d82a87a-2609-42fb-8212-b7d0e9b05464 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:10.347033 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-64f6e170-dd8c-49db-a4d1-017440a250c6 req-2d82a87a-2609-42fb-8212-b7d0e9b05464 service nova] Creating event network-vif-plugged:300c880f-2fc9-4f7e-9677-0ec892ca7a68 for instance a436d761-1adc-477e-b18c-cf92ca8a7acc on hv-cinder-82481 Jan 15 15:49:10.351847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-64f6e170-dd8c-49db-a4d1-017440a250c6 req-2d82a87a-2609-42fb-8212-b7d0e9b05464 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029492 Jan 15 15:49:10.352456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 83/155] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:49:10.589387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:10.590068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:10.599487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:10.600049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:10.600876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:10.601373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:10.757531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:10.759059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:10.759854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:10.766091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:10.766606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:10.767387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:10.767712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:10.767828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:10.770190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:10.771625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2571f520-3aa8-47b2-aeba-703d9179aa99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.186483 Jan 15 15:49:10.772384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 73/156] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:10 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:11.029501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:11.036792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f680ada7-519b-4e13-b0a1-d7fcb9832c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.281646 Jan 15 15:49:11.037358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 84/157] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:10 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:11.789924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:11.790539 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:11.797344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:11.797801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:11.798584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:11.799026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:11.923613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:11.931352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:11.933169 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:11.934267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ab46ff54-dfc7-4de5-8a6e-6f28c7f42225 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.147996 Jan 15 15:49:11.934811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 74/158] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:11 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:12.053086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:12.053697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:12.059710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:12.060189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:12.060968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:12.061406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:12.188468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:12.195572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4785d4cc-c0b7-42cc-81e4-12903218d018 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.146167 Jan 15 15:49:12.196131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 85/159] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:12 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:12.954549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:12.955263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:12.961608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:12.965703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:12.965703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:12.965703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:13.092912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:13.100846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:13.102386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:13.104156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-906a59cd-cffd-4161-9e9e-848a6e25d22a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.153292 Jan 15 15:49:13.104784 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 75/160] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:12 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 15:49:13.214121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:13.214742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:13.220526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:13.220983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:13.221762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:13.222247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:13.355745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:13.363623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-14c12cc1-9ec4-4f30-b55c-173eea7bdbc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.153712 Jan 15 15:49:13.364224 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 86/161] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:13 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:14.121966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:14.122588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:14.128382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:14.128823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:14.129584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:14.130016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:14.256180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:14.263859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:14.265422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:14.266517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-55b3a0fa-2b53-4c29-9ae2-acdfaf0abc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.149152 Jan 15 15:49:14.267082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 76/162] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:14 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:14.381740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:14.382277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:14.388301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:14.388752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:14.389519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:14.389948 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:14.514978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:14.522293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fe10895e-a002-4d17-bca1-2637ee71105b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.144240 Jan 15 15:49:14.522855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 87/163] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:14 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:15.284519 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:15.285048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:15.290924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:15.291696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:15.292507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:15.292942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:15.421437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:15.429327 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:15.430830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:15.432709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5a15794d-c55a-48b5-b1c2-fbf4b1a2320a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.151901 Jan 15 15:49:15.433278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 77/164] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:15 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:15.539907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:15.540484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:15.546572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:15.547281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:15.548054 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:15.548527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:15.674551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:15.681833 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7878f78f-132d-4f6c-a604-30569a32d395 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.145614 Jan 15 15:49:15.682424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 88/165] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:15 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:16.451534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:16.452159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:16.458067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:16.458523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:16.459297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:16.459734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:16.588450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:16.596219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:16.597710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:16.598794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-00701d48-2f5c-4216-84bb-6fcba7823737 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.151892 Jan 15 15:49:16.599343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 78/166] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:16 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:16.698596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:16.699245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:16.705510 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:16.705973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:16.706685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:16.707117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:16.837107 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:16.844442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d65fc6d2-14cb-4a28-8a25-773686b7978c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.149976 Jan 15 15:49:16.844993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 89/167] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:16 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:17.616314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:17.617472 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:17.624021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:17.624699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:17.625481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:17.625911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:17.763885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:17.773290 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:17.774857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:17.775987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ae93cf0b-e863-4f46-828f-a89a4c500f0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1407 microversion: 2.20 time: 0.163510 Jan 15 15:49:17.776605 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 79/168] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:17 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:17.861097 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:17.862346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:17.868277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:17.868668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:17.870147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:17.870805 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:18.011841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:18.027226 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f9763d93-ddc3-4e46-ad9a-5fa4215221a0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1322 microversion: 2.1 time: 0.169825 Jan 15 15:49:18.027816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 90/169] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:17 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:18.794303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:18.794915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:18.801147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:18.801599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:18.802378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:18.802814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:18.948942 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4e340dc2-5afc-4e53-bbe6-2878cac4339f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31d3db78-a57e-45db-9690-397cc103d155"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:18.950171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4e340dc2-5afc-4e53-bbe6-2878cac4339f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:18.957268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e340dc2-5afc-4e53-bbe6-2878cac4339f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:18.957719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e340dc2-5afc-4e53-bbe6-2878cac4339f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:18.958521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e340dc2-5afc-4e53-bbe6-2878cac4339f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:18.959047 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4e340dc2-5afc-4e53-bbe6-2878cac4339f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.079715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:19.088172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:19.090313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:19.092447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fc150456-1fe3-4dea-b9bf-f497295c4ab0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1599 microversion: 2.20 time: 0.302511 Jan 15 15:49:19.093477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 80/170] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:49:18 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1599 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:19.097986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:19.099268 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:19.108787 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.109525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.110325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.110925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.259218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:19.266942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b1290a58-0d5f-494e-84af-74996e48b9de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1515 microversion: 2.1 time: 0.172254 Jan 15 15:49:19.267523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 81/171] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:19 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:19.272122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0650e2f6-f71f-447c-8752-5be3e3cd3633 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:19.273354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0650e2f6-f71f-447c-8752-5be3e3cd3633 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:19.279643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0650e2f6-f71f-447c-8752-5be3e3cd3633 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.280259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0650e2f6-f71f-447c-8752-5be3e3cd3633 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.281287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0650e2f6-f71f-447c-8752-5be3e3cd3633 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.281995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0650e2f6-f71f-447c-8752-5be3e3cd3633 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.402448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0650e2f6-f71f-447c-8752-5be3e3cd3633 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133661 Jan 15 15:49:19.403041 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 82/172] 10.222.0.36 () {60 vars in 1315 bytes} [Sat Jan 15 15:49:19 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:49:19.407965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:19.408987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:19.418678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.418678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.418678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.418678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.448737 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lazy-loading 'flavor' on Instance uuid a436d761-1adc-477e-b18c-cf92ca8a7acc {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:49:19.793558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9cc3ddec-9bf5-47b4-b9a3-9c79dedb3fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc/action" status: 200 len: 32 microversion: 2.1 time: 0.389059 Jan 15 15:49:19.795284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 83/173] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:49:19 2022] POST /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:49:19.806989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:19.807723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:19.824313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.824950 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:19.825930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:19.826532 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:20.286620 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4e340dc2-5afc-4e53-bbe6-2878cac4339f tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "POST /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.341344 Jan 15 15:49:20.293302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 91/174] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 15:49:18 2022] POST /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809/os-volume_attachments => generated 194 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:49:20.396718 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:20.410786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2df24ce5-6a85-42ab-bea5-763419467f40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.610646 Jan 15 15:49:20.412266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 84/175] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:19 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:21.361943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6db26516-8478-45ff-ad87-282087428494 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:21.362476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-4c0fdd1a-20c7-4155-8b31-4bfbdf502bc9 req-e4bd94f6-6fac-4059-838d-ca48f5a59991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62b0ad3-733e-4543-8395-a9ebb0de6702", "tag": "c57c6f6f-54d0-451c-936b-073bd33f289b"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:21.367711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6db26516-8478-45ff-ad87-282087428494 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:21.367821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:21.367821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:49:21.370423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6db26516-8478-45ff-ad87-282087428494 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:21.370876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6db26516-8478-45ff-ad87-282087428494 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:21.371700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6db26516-8478-45ff-ad87-282087428494 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:21.372165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6db26516-8478-45ff-ad87-282087428494 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:21.372363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-4c0fdd1a-20c7-4155-8b31-4bfbdf502bc9 req-e4bd94f6-6fac-4059-838d-ca48f5a59991 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:21.372805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-4c0fdd1a-20c7-4155-8b31-4bfbdf502bc9 req-e4bd94f6-6fac-4059-838d-ca48f5a59991 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:21.383621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-4c0fdd1a-20c7-4155-8b31-4bfbdf502bc9 req-e4bd94f6-6fac-4059-838d-ca48f5a59991 service nova] Creating event network-changed:c57c6f6f-54d0-451c-936b-073bd33f289b for instance a62b0ad3-733e-4543-8395-a9ebb0de6702 on hv-cinder-82481 Jan 15 15:49:21.390401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-4c0fdd1a-20c7-4155-8b31-4bfbdf502bc9 req-e4bd94f6-6fac-4059-838d-ca48f5a59991 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Jan 15 15:49:21.392368 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 85/176] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:49:21.430761 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:21.433460 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:21.440061 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:21.440789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:21.441726 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:21.442305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:21.475213 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6db26516-8478-45ff-ad87-282087428494 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.118047 Jan 15 15:49:21.475854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 92/177] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:21 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:21.631890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:21.641228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-94a1b607-d2e2-44c8-80e5-c34f59f35e61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.214669 Jan 15 15:49:21.641529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 86/178] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:21 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:22.496447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aefa4fb2-a976-45dc-beb2-f9657a8f9ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:22.500990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aefa4fb2-a976-45dc-beb2-f9657a8f9ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:22.510741 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aefa4fb2-a976-45dc-beb2-f9657a8f9ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:22.511434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aefa4fb2-a976-45dc-beb2-f9657a8f9ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:22.512429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aefa4fb2-a976-45dc-beb2-f9657a8f9ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:22.514604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aefa4fb2-a976-45dc-beb2-f9657a8f9ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:22.600684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aefa4fb2-a976-45dc-beb2-f9657a8f9ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.113872 Jan 15 15:49:22.604550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 93/179] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:22 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:22.658762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:22.659665 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:22.670536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:22.671111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:22.673036 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:22.674800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:22.888317 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:22.918867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4e08a846-1557-480e-bbb5-98bf3deafea0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.264256 Jan 15 15:49:22.919487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 87/180] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:22 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:23.611752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-20be94ea-2744-4445-a39c-70ddad8859ab tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:23.613013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-20be94ea-2744-4445-a39c-70ddad8859ab tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:23.619966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20be94ea-2744-4445-a39c-70ddad8859ab tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:23.620519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20be94ea-2744-4445-a39c-70ddad8859ab tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:23.621479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20be94ea-2744-4445-a39c-70ddad8859ab tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:23.621918 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20be94ea-2744-4445-a39c-70ddad8859ab tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:23.696180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-20be94ea-2744-4445-a39c-70ddad8859ab tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.088240 Jan 15 15:49:23.701716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 94/181] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:23 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:23.936429 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:23.937100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:23.943034 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:23.943488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:23.944299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:23.944737 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:24.092344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:24.100978 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-708df4bd-2477-42f8-8aef-7b5c733562be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.168361 Jan 15 15:49:24.101552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 88/182] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:23 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:24.711076 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d14366a8-2450-44a1-88d8-4a39ff1f0dda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:24.712071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d14366a8-2450-44a1-88d8-4a39ff1f0dda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:24.719507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d14366a8-2450-44a1-88d8-4a39ff1f0dda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:24.719950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d14366a8-2450-44a1-88d8-4a39ff1f0dda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:24.720757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d14366a8-2450-44a1-88d8-4a39ff1f0dda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:24.721193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d14366a8-2450-44a1-88d8-4a39ff1f0dda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:24.812519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d14366a8-2450-44a1-88d8-4a39ff1f0dda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.104847 Jan 15 15:49:24.813647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 95/183] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:24 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:25.118362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:25.119763 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:25.125740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:25.132486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:25.132486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:25.132486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:25.258852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:25.268446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a12bf607-c8e5-47e2-845c-f7115d6a70ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.153809 Jan 15 15:49:25.269026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 89/184] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:25 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:25.824922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1c1379a5-618b-4007-a35f-cfd4129ba17f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:25.826308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1c1379a5-618b-4007-a35f-cfd4129ba17f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:25.833022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c1379a5-618b-4007-a35f-cfd4129ba17f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:25.833508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c1379a5-618b-4007-a35f-cfd4129ba17f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:25.839152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c1379a5-618b-4007-a35f-cfd4129ba17f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:25.839152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c1379a5-618b-4007-a35f-cfd4129ba17f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:25.899925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1c1379a5-618b-4007-a35f-cfd4129ba17f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.079677 Jan 15 15:49:25.902859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 96/185] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:25 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:26.285470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:26.286208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:26.297587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:26.298152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:26.298948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:26.299407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:26.589071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:26.589071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e2f4e9ab-b8d6-4c52-977d-08b373f783ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.164460 Jan 15 15:49:26.589071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 90/186] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:26 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:26.912190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6e4140e7-6983-4a82-92db-eaac6c8d961b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:26.913312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6e4140e7-6983-4a82-92db-eaac6c8d961b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:26.922870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e4140e7-6983-4a82-92db-eaac6c8d961b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:26.923423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e4140e7-6983-4a82-92db-eaac6c8d961b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:26.924347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e4140e7-6983-4a82-92db-eaac6c8d961b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:26.924858 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e4140e7-6983-4a82-92db-eaac6c8d961b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:27.009637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6e4140e7-6983-4a82-92db-eaac6c8d961b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.101607 Jan 15 15:49:27.010628 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 97/187] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:26 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:27.598442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:27.599052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:27.604746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:27.608168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:27.608168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:27.608168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:27.742953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:27.750866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-971a12ba-e0c2-4c18-b6a6-e87acd882c08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.156033 Jan 15 15:49:27.751452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 91/188] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:27 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:28.021020 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b7dcb659-d11a-4143-8e74-6e9f33e34eda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:28.022034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b7dcb659-d11a-4143-8e74-6e9f33e34eda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:28.029981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7dcb659-d11a-4143-8e74-6e9f33e34eda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:28.030442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7dcb659-d11a-4143-8e74-6e9f33e34eda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:28.031242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7dcb659-d11a-4143-8e74-6e9f33e34eda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:28.031690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7dcb659-d11a-4143-8e74-6e9f33e34eda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:28.125382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b7dcb659-d11a-4143-8e74-6e9f33e34eda tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.108246 Jan 15 15:49:28.127154 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 98/189] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:28 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:28.769278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:28.769897 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:28.786412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:28.787037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:28.787993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:28.788601 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:28.958398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:28.966611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-50efee4b-4697-4e33-bdf2-f3efb54d6218 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.201789 Jan 15 15:49:28.967701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 92/190] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:28 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:29.140380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ec0630c4-9cd7-4a7a-bd89-b8b5f6ffe49b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:29.141427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ec0630c4-9cd7-4a7a-bd89-b8b5f6ffe49b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:29.148495 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ec0630c4-9cd7-4a7a-bd89-b8b5f6ffe49b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:29.148969 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ec0630c4-9cd7-4a7a-bd89-b8b5f6ffe49b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:29.150406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ec0630c4-9cd7-4a7a-bd89-b8b5f6ffe49b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:29.151026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ec0630c4-9cd7-4a7a-bd89-b8b5f6ffe49b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:29.237774 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ec0630c4-9cd7-4a7a-bd89-b8b5f6ffe49b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.101580 Jan 15 15:49:29.239669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 99/191] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:29 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:29.985069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:29.985715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:29.991642 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:29.992095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:29.992912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:29.993387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:30.126796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:30.134554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6e0996ad-0339-41fe-8f4b-6fd392145ee1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.152888 Jan 15 15:49:30.135132 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 93/192] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:29 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:30.250463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4cbd67c5-38bd-4382-afa2-6b1848b4a6ea tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:30.251465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4cbd67c5-38bd-4382-afa2-6b1848b4a6ea tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:30.258325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cbd67c5-38bd-4382-afa2-6b1848b4a6ea tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:30.259630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cbd67c5-38bd-4382-afa2-6b1848b4a6ea tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:30.260617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cbd67c5-38bd-4382-afa2-6b1848b4a6ea tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:30.261050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cbd67c5-38bd-4382-afa2-6b1848b4a6ea tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:30.337913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4cbd67c5-38bd-4382-afa2-6b1848b4a6ea tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.090535 Jan 15 15:49:30.341111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 100/193] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:30 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:30.473105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:30.473598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:30.480535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:30.481179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:30.482333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:30.483176 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:30.514342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 15:49:30.914110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-46d28136-72e9-4fcb-a47c-7d1b75b8a3b8 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 204 len: 0 microversion: 2.1 time: 0.444290 Jan 15 15:49:30.914741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 94/194] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 15:49:30 2022] DELETE /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 15:49:30.926247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:30.927117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:30.936316 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:30.937043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:30.943527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:30.943527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:31.151480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:31.155790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:31.159762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:31.160445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:31.161757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:31.162634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:31.284499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:31.292967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-540c492f-267c-4d7b-9197-dfa75246058a tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1554 microversion: 2.1 time: 0.371533 Jan 15 15:49:31.293550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 101/195] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:30 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1554 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:31.331829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:31.339350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-284025c1-9440-41b2-beb1-0abbf398010b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.191999 Jan 15 15:49:31.342800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 95/196] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:31 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:31.352458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f12dced9-f536-4ffb-9787-b4d533836b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:31.353782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f12dced9-f536-4ffb-9787-b4d533836b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:31.360519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f12dced9-f536-4ffb-9787-b4d533836b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:31.360982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f12dced9-f536-4ffb-9787-b4d533836b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:31.361779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f12dced9-f536-4ffb-9787-b4d533836b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:31.362227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f12dced9-f536-4ffb-9787-b4d533836b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:31.428040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f12dced9-f536-4ffb-9787-b4d533836b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.082445 Jan 15 15:49:31.428839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 102/197] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:31 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:32.311340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:32.311948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:32.318000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:32.318579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:32.319228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:32.319654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:32.359465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:32.360242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:32.367740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:32.368348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:32.369762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:32.370216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:32.571079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:32.583634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2ddcdeb3-ab67-4457-be15-0aa121afd0c6 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1554 microversion: 2.1 time: 0.275791 Jan 15 15:49:32.584080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:32.584743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 96/198] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:32 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:32.591107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-beed706d-9922-48d7-8d5d-ba5be03047ac tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:32.592261 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-beed706d-9922-48d7-8d5d-ba5be03047ac tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:32.598368 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-beed706d-9922-48d7-8d5d-ba5be03047ac tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:32.600424 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-beed706d-9922-48d7-8d5d-ba5be03047ac tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:32.602110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-beed706d-9922-48d7-8d5d-ba5be03047ac tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:32.602694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-beed706d-9922-48d7-8d5d-ba5be03047ac tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:32.606062 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c77608fe-cf31-42b7-ba9c-9d01a56ec732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.250507 Jan 15 15:49:32.616714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 103/199] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:32 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:32.718616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-beed706d-9922-48d7-8d5d-ba5be03047ac tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 14 microversion: 2.20 time: 0.132431 Jan 15 15:49:32.719239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 97/200] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:32 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:33.601561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:33.602399 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:33.611227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:33.611807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:33.612914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:33.613504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:33.624606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:33.625481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:33.634836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:33.637562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:33.638334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:33.638780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:33.837802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:33.846270 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b1e7a0f8-73c6-4ee3-b109-c053002f2712 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1554 microversion: 2.1 time: 0.248747 Jan 15 15:49:33.848479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 104/201] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:33 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:33.854303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-eba1cbc2-d7ab-4225-9bcb-61f7f0c0a953 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:33.855296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-eba1cbc2-d7ab-4225-9bcb-61f7f0c0a953 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:33.868345 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:33.873890 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eba1cbc2-d7ab-4225-9bcb-61f7f0c0a953 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:33.874884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eba1cbc2-d7ab-4225-9bcb-61f7f0c0a953 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:33.875847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eba1cbc2-d7ab-4225-9bcb-61f7f0c0a953 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:33.876473 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eba1cbc2-d7ab-4225-9bcb-61f7f0c0a953 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:33.877505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4a516bf7-9437-4042-8797-1b0d08398489 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.257367 Jan 15 15:49:33.887727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 98/202] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:33 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:33.980160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-eba1cbc2-d7ab-4225-9bcb-61f7f0c0a953 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 6451 microversion: 2.20 time: 0.127820 Jan 15 15:49:33.980440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 105/203] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:33 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 6451 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:49:34.445699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-b909a6d1-26e2-4f4d-86d5-a7e143b7275f req-2af04b6e-84ff-4f32-987b-ce6084ca681a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456f3da5-cdea-4d59-8273-bb6954e3e809", "name": "network-vif-deleted", "tag": "bb3f643d-10ce-4fe2-a626-ca1acff6ab05"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:34.447950 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:34.447950 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:49:34.456493 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-b909a6d1-26e2-4f4d-86d5-a7e143b7275f req-2af04b6e-84ff-4f32-987b-ce6084ca681a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:34.457033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-b909a6d1-26e2-4f4d-86d5-a7e143b7275f req-2af04b6e-84ff-4f32-987b-ce6084ca681a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:34.468432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-b909a6d1-26e2-4f4d-86d5-a7e143b7275f req-2af04b6e-84ff-4f32-987b-ce6084ca681a service nova] Creating event network-vif-deleted:bb3f643d-10ce-4fe2-a626-ca1acff6ab05 for instance 456f3da5-cdea-4d59-8273-bb6954e3e809 on hv-cinder-82481 Jan 15 15:49:34.473285 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-b909a6d1-26e2-4f4d-86d5-a7e143b7275f req-2af04b6e-84ff-4f32-987b-ce6084ca681a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 Jan 15 15:49:34.477182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 99/204] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:49:34.865598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:34.866857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:34.874770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:34.875458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:34.876487 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:34.877109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:34.897955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:34.903192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:34.918892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:34.919701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:34.920846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:34.922708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:34.985477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:34.995261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1c8e2e73-c9b7-42e2-8fed-ce9603d73818 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1346 microversion: 2.1 time: 0.135182 Jan 15 15:49:34.995917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 106/205] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:34 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:35.008173 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d0a7a3cf-a95b-4c39-9c0a-89a75fc4ddfb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:35.010307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d0a7a3cf-a95b-4c39-9c0a-89a75fc4ddfb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:35.017914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0a7a3cf-a95b-4c39-9c0a-89a75fc4ddfb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:35.022588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0a7a3cf-a95b-4c39-9c0a-89a75fc4ddfb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:35.022588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0a7a3cf-a95b-4c39-9c0a-89a75fc4ddfb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:35.022588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0a7a3cf-a95b-4c39-9c0a-89a75fc4ddfb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:35.126594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d0a7a3cf-a95b-4c39-9c0a-89a75fc4ddfb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 13039 microversion: 2.20 time: 0.124840 Jan 15 15:49:35.127600 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 107/206] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:35 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 13039 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:35.131379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:35.139569 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dec197f7-504c-4645-9b22-2526e5a6e9ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.247911 Jan 15 15:49:35.140551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 100/207] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:34 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:35.907572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1263110739", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "d059c46f-e9ac-4afd-b199-b7dfd54e46e5"}]}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:35.981277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.network.neutron [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] validate_networks() for [('d059c46f-e9ac-4afd-b199-b7dfd54e46e5', None, None, None, None, None)] {{(pid=123221) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:49:36.012439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:36.013597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:36.026702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.027416 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.031006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.031006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.065595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.066042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.066681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lazy-loading 'fault' on Instance uuid 456f3da5-cdea-4d59-8273-bb6954e3e809 {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:49:36.124809 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da755e3e160a455f95b793d2c1a91323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca064050918d4006b60e60198b66171d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:36.134839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-82919044-c8f4-48bb-b8ce-0a56aa66769e tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 200 len: 1351 microversion: 2.1 time: 0.126600 Jan 15 15:49:36.135610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 101/208] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:36 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:36.141018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-84afb236-83dd-4321-a80c-e25dd8094793 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:36.142033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-84afb236-83dd-4321-a80c-e25dd8094793 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:36.152500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84afb236-83dd-4321-a80c-e25dd8094793 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.152500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84afb236-83dd-4321-a80c-e25dd8094793 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.152500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84afb236-83dd-4321-a80c-e25dd8094793 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.152500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84afb236-83dd-4321-a80c-e25dd8094793 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.234967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-84afb236-83dd-4321-a80c-e25dd8094793 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 16486 microversion: 2.20 time: 0.096775 Jan 15 15:49:36.235633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 102/209] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:36 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 16486 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:36.241653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:36.243856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:36.255740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.256419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.258031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.260370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.492275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Flavor limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:49:36.492405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Image limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:49:36.492886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Flavor pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:49:36.496027 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:36.499437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Image pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:49:36.500052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:49:36.503679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1a66f2a3-3b9f-44ba-86fc-caf922001834 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.266756 Jan 15 15:49:36.504244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 103/210] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:36 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:36.514860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.514860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.514860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:36.515257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:36.538079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Getting quotas for project 7848167bcae046ed80e861268575fcb1. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:49:36.543430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Getting quotas for user 2f6cb0d17d33488e8f8ac79b9a764d90 and project 7848167bcae046ed80e861268575fcb1. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:49:36.556302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Going to run 1 instances... {{(pid=123221) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:49:36.560032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:49:36.705038 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-877ed601-3774-40ad-9e7a-1aaa301d5f47 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801864 Jan 15 15:49:36.705683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 108/211] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:49:36.715830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-46b1705f-fd28-46b1-9a5b-d89395b8e269 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:36.716757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-46b1705f-fd28-46b1-9a5b-d89395b8e269 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:36.778023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-46b1705f-fd28-46b1-9a5b-d89395b8e269 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:36.784694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-46b1705f-fd28-46b1-9a5b-d89395b8e269 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1214 microversion: 2.1 time: 0.072483 Jan 15 15:49:36.785270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 104/212] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:36 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:37.159555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:37.160764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:37.169735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.170181 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.171123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.173326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.191883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] HTTP exception thrown: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. Jan 15 15:49:37.192695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Returning 404 to user: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:49:37.193831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5d663620-b5ea-4456-bc06-4095d617c799 tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 404 len: 111 microversion: 2.1 time: 0.038407 Jan 15 15:49:37.194802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 109/213] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:37 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:49:37.250861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-432878c3-4a83-40bd-bcc3-3af7dc196edf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:37.251831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-432878c3-4a83-40bd-bcc3-3af7dc196edf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:37.259871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-432878c3-4a83-40bd-bcc3-3af7dc196edf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.262042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-432878c3-4a83-40bd-bcc3-3af7dc196edf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.263677 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-432878c3-4a83-40bd-bcc3-3af7dc196edf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.264242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-432878c3-4a83-40bd-bcc3-3af7dc196edf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.313822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:37.314931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:37.323889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.324689 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.326000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.326639 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.346598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] HTTP exception thrown: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. Jan 15 15:49:37.348525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Returning 404 to user: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:49:37.350313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-355fd1d5-887b-4e6e-a289-7e46aac1e28d tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040700 Jan 15 15:49:37.351610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 110/214] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:49:37 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 15:49:37.520531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:37.521174 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:37.528075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.532092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.532959 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:37.533657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:37.738726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:37.748522 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-249bd688-0ea5-4cac-be76-ac291a42b44c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.231613 Jan 15 15:49:37.749390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 111/215] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:37 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:37.802870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fa89a9df-c6e8-4e7f-a754-cdf80ead8c51 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:37.803481 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fa89a9df-c6e8-4e7f-a754-cdf80ead8c51 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:37.862986 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fa89a9df-c6e8-4e7f-a754-cdf80ead8c51 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:37.888627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fa89a9df-c6e8-4e7f-a754-cdf80ead8c51 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1214 microversion: 2.1 time: 0.089335 Jan 15 15:49:37.896320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 112/216] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:37 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:38.765193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:38.765804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:38.772291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:38.772782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:38.773577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:38.774040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:38.906774 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:38.916799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-051c7463-d149-44ce-98c0-6f75a9a28cbc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.155178 Jan 15 15:49:38.917563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 113/217] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:38 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:38.922380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:38.922985 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:38.928754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:38.929208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:38.929991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:38.930433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:38.989739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:38.997830 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3500447e-7602-46df-a75c-3ca31dd281fa tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1218 microversion: 2.1 time: 0.079096 Jan 15 15:49:38.998469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 114/218] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:38 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:39.934677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:39.935398 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:39.941531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:39.941978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:39.942754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:39.943227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:40.082170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:40.090225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-acc8af57-5f31-4390-8df7-dcbacb79d88b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.160051 Jan 15 15:49:40.090775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 115/219] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:39 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:40.095055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:40.095661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:40.101227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:40.101682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:40.103127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:40.103765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:40.159978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:40.167869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-736d8d23-33ba-405c-afd2-5c4e120d519f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1218 microversion: 2.1 time: 0.076010 Jan 15 15:49:40.168480 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 116/220] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:40 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:41.002612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-432878c3-4a83-40bd-bcc3-3af7dc196edf tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 23986 microversion: 2.20 time: 3.756086 Jan 15 15:49:41.004828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 105/221] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:37 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 23986 bytes in 3758 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:41.106499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:41.107833 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:41.119267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:41.119267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:41.119267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:41.119267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:41.186486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:41.187409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:41.205444 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:41.205883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:41.206683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:41.207127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:41.269379 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:41.277065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-08e8e0d9-e2d9-4042-8214-3852d2199540 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.174256 Jan 15 15:49:41.277936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 117/222] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:41 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:41.284065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:41.292961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-72660b39-0791-469c-8bf4-534b092c8e39 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1218 microversion: 2.1 time: 0.111019 Jan 15 15:49:41.293529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 106/223] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:41 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:42.013226 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c6bae306-8c40-49d7-8c86-171e44eaac6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:42.014232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c6bae306-8c40-49d7-8c86-171e44eaac6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:42.020117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6bae306-8c40-49d7-8c86-171e44eaac6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:42.020604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6bae306-8c40-49d7-8c86-171e44eaac6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:42.021453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6bae306-8c40-49d7-8c86-171e44eaac6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:42.021900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6bae306-8c40-49d7-8c86-171e44eaac6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:42.131254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c6bae306-8c40-49d7-8c86-171e44eaac6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 25146 microversion: 2.20 time: 0.121440 Jan 15 15:49:42.135446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 118/224] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:42 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 25146 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:42.294835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:42.295499 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:42.302084 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:42.302533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:42.303308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:42.303745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:42.309835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:42.310544 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:42.317462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:42.319460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:42.319460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:42.319460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:42.390176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:42.397690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6ec468f3-b28d-46f0-a6c7-1a33c2c543f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1274 microversion: 2.1 time: 0.092074 Jan 15 15:49:42.398265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 119/225] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:42 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:42.454250 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:42.461840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-97335a15-1330-4b53-9bbf-bf70cf4eacb0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.171243 Jan 15 15:49:42.465632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 107/226] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:42 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:43.142949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-95926031-054a-4f20-b142-4be8aa59ed6e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:43.144051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-95926031-054a-4f20-b142-4be8aa59ed6e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:43.151748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95926031-054a-4f20-b142-4be8aa59ed6e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:43.152243 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95926031-054a-4f20-b142-4be8aa59ed6e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:43.153041 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95926031-054a-4f20-b142-4be8aa59ed6e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:43.153480 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95926031-054a-4f20-b142-4be8aa59ed6e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:43.414498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:43.415821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:43.422585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:43.423038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:43.423806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:43.424273 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:43.485793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:43.493811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d3eeccbb-1bea-475b-a37a-61446b426013 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1274 microversion: 2.1 time: 0.082320 Jan 15 15:49:43.494455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 108/227] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:43 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:43.498770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:43.499359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:43.505148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:43.505624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:43.506395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:43.506831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:43.631428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:43.639228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0763a4ee-a7f3-4273-8e01-91b22ef2fad0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.143783 Jan 15 15:49:43.639803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 109/228] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:43 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:44.510694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:44.511299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:44.517521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:44.517971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:44.518750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:44.519182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:44.576514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:44.583548 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2f5781d3-a2d8-4a97-b92f-3f17851ff6ad tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1284 microversion: 2.1 time: 0.076670 Jan 15 15:49:44.584111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 110/229] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:44 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1284 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:44.656039 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:44.656662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:44.662466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:44.662912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:44.663683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:44.664116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:44.791275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:44.798639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-34473850-efc1-46a5-bd3d-631a2c164920 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.146095 Jan 15 15:49:44.799202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 111/230] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:44 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:45.601397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:45.603314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:45.609640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:45.610164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:45.611018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:45.611513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:45.736699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:45.744291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e8b6bd22-605c-4335-aad8-cbc258174bcb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.146463 Jan 15 15:49:45.744855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 112/231] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:45 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:45.814432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:45.814959 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:45.820644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:45.821600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:45.822373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:45.822800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:45.949704 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:45.956992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2308b03e-def2-4aef-96d4-1da0938fe767 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.146138 Jan 15 15:49:45.957554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 113/232] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:45 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:46.374819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-95926031-054a-4f20-b142-4be8aa59ed6e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 27694 microversion: 2.20 time: 3.235426 Jan 15 15:49:46.375464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 120/233] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:43 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 27694 bytes in 3237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:49:46.761992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:46.762817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:46.769875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:46.770429 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:46.771408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:46.772912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:46.925487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:46.935231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-87caa438-7c57-46b3-b579-eed55639ad79 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.177168 Jan 15 15:49:46.945232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 114/234] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:46 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:46.974191 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:46.974891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:46.983052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:46.984422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:46.984422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:46.984747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:47.138042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:47.146596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4ba17c0e-4a3d-481e-8924-56974770d360 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.176376 Jan 15 15:49:47.147151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 121/235] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:46 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:47.254880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-6072c495-1b09-4963-afd4-9c8ccd0d878c req-187510fd-7e31-4a48-847f-5df67860bb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dd480b-0e91-44ac-a189-bab233c60939", "tag": "4f9cced9-e62d-4dcf-ad40-ab659a7cdf1b"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:47.256458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:47.256458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:49:47.264915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6072c495-1b09-4963-afd4-9c8ccd0d878c req-187510fd-7e31-4a48-847f-5df67860bb19 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:47.265439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6072c495-1b09-4963-afd4-9c8ccd0d878c req-187510fd-7e31-4a48-847f-5df67860bb19 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:47.284506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-6072c495-1b09-4963-afd4-9c8ccd0d878c req-187510fd-7e31-4a48-847f-5df67860bb19 service nova] Creating event network-changed:4f9cced9-e62d-4dcf-ad40-ab659a7cdf1b for instance 82dd480b-0e91-44ac-a189-bab233c60939 on hv-cinder-82481 Jan 15 15:49:47.289353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-6072c495-1b09-4963-afd4-9c8ccd0d878c req-187510fd-7e31-4a48-847f-5df67860bb19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038016 Jan 15 15:49:47.289951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 115/236] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:49:47.389144 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-96e3b542-eb7e-46d7-8158-37d426d7044c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:47.389144 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-96e3b542-eb7e-46d7-8158-37d426d7044c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:47.396333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-96e3b542-eb7e-46d7-8158-37d426d7044c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:47.396901 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-96e3b542-eb7e-46d7-8158-37d426d7044c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:47.397894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-96e3b542-eb7e-46d7-8158-37d426d7044c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:47.403310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-96e3b542-eb7e-46d7-8158-37d426d7044c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:47.512737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-96e3b542-eb7e-46d7-8158-37d426d7044c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 27744 microversion: 2.20 time: 0.129469 Jan 15 15:49:47.516605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 122/237] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:47 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 27744 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:47.954013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:47.955444 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:47.962594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:47.963166 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:47.965230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:47.965780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.118281 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:48.125855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9545a8b8-0da1-47ac-b699-e564a7378312 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.176407 Jan 15 15:49:48.126492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 116/238] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:47 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:48.165299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:48.166313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:48.173752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:48.174334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:48.174907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.175523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.176607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.177068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.180687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.181141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.181926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.182404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.195960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] HTTP exception thrown: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. Jan 15 15:49:48.196596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Returning 404 to user: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:49:48.197426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b8a74707-9ca4-419d-8803-909bc4b8ba5b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 404 len: 111 microversion: 2.1 time: 0.027626 Jan 15 15:49:48.198559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 117/239] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 15:49:48 2022] DELETE /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 15:49:48.213097 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:48.214348 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] [instance: 456f3da5-cdea-4d59-8273-bb6954e3e809] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:48.220453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.220915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.221704 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.222145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.235487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] HTTP exception thrown: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. Jan 15 15:49:48.236156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] Returning 404 to user: Instance 456f3da5-cdea-4d59-8273-bb6954e3e809 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:49:48.237159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-54e48896-ce31-4348-897e-faa696ae1e8b tempest-DeleteServersTestJSON-577431521 tempest-DeleteServersTestJSON-577431521-project] 10.222.0.36 "GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809" status: 404 len: 111 microversion: 2.1 time: 0.027603 Jan 15 15:49:48.237708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 118/240] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:48 2022] GET /compute/v2.1/servers/456f3da5-cdea-4d59-8273-bb6954e3e809 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 15:49:48.327923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:48.328185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5834eebb-afb5-48de-be5d-4c2d6b0d28d2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.166877 Jan 15 15:49:48.328589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 123/241] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:48 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:48.524457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a4bdb34b-6a50-4d9d-8840-08fffc381ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:48.529497 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a4bdb34b-6a50-4d9d-8840-08fffc381ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:48.535658 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a4bdb34b-6a50-4d9d-8840-08fffc381ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.539342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a4bdb34b-6a50-4d9d-8840-08fffc381ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:48.539342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a4bdb34b-6a50-4d9d-8840-08fffc381ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:48.539342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a4bdb34b-6a50-4d9d-8840-08fffc381ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:49.142796 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:49.143405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:49.149434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:49.150075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:49.151521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:49.152101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:49.292681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:49.302220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-295d5f40-82fb-442c-a486-da48c5f82ad3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.163218 Jan 15 15:49:49.302801 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 124/242] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:49 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:49.345381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:49.345987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:49.351803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:49.352287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:49.353121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:49.353534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:49.503706 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:49.512331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-014e3e9a-24dc-48fd-b8b3-bc0d8cbb0446 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.170470 Jan 15 15:49:49.513285 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 125/243] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:49 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:50.322331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:50.323727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:50.332839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:50.332839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:50.332839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:50.332839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:50.474579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:50.482077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d2add1cb-f314-46ef-8c8d-783ee036fdb7 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.163310 Jan 15 15:49:50.482666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 126/244] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:50 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:50.528672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:50.529349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:50.535078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:50.535540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:50.536366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:50.536819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:50.676669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:50.684541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d715497b-767d-4e3b-aade-48952630e103 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.159400 Jan 15 15:49:50.685114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 127/245] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:50 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:51.499712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:51.500391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:51.506806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:51.507260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:51.508045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:51.508513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:51.646875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:51.656668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-20c8067e-7238-4d74-b2f6-eb45343bd287 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.160597 Jan 15 15:49:51.657392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 128/246] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:51 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:51.702146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:51.702766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:51.708872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:51.709332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:51.710210 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:51.710657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:51.850500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:51.858847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ad9cab36-cf07-4fd1-b7d7-1f4a04efd386 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.160824 Jan 15 15:49:51.859417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 129/247] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:51 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:52.124779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a4bdb34b-6a50-4d9d-8840-08fffc381ffe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 27810 microversion: 2.20 time: 3.604001 Jan 15 15:49:52.129484 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 119/248] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:48 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 27810 bytes in 3606 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:52.674631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:52.675253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:52.692516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:52.693027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:52.693872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:52.694315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:52.914703 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:52.914963 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:52.914963 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:52.915263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c0ee4227-bd5b-41a7-9444-b1f8f5659824 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.207158 Jan 15 15:49:52.915263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 130/249] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:52 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:52.915765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:52.915765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:52.915765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:52.915765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:53.047909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:53.055209 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-eee9027f-1504-49da-b19a-5018e4353551 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.183711 Jan 15 15:49:53.055812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 120/250] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:52 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:53.137372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-38d132d3-c146-4564-a547-5acaa4c0cb4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:53.138302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-38d132d3-c146-4564-a547-5acaa4c0cb4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:53.149360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d132d3-c146-4564-a547-5acaa4c0cb4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:53.153293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d132d3-c146-4564-a547-5acaa4c0cb4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:53.153293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d132d3-c146-4564-a547-5acaa4c0cb4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:53.153293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d132d3-c146-4564-a547-5acaa4c0cb4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:53.261628 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-38d132d3-c146-4564-a547-5acaa4c0cb4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 27810 microversion: 2.20 time: 0.128375 Jan 15 15:49:53.262276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 131/251] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:53 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 27810 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:53.894488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:53.895165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:53.902382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:53.902833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:53.903600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:53.904032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:54.062602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:54.071765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-168abde2-3aa8-4340-9f35-a725304b416c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.179837 Jan 15 15:49:54.071765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 121/252] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:53 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:54.073754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:54.074835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:54.081877 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:54.082547 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:54.083621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:54.084693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:54.258378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:54.267371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-dd8de7df-b0c1-4f89-98ad-535530acb91c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.198877 Jan 15 15:49:54.268612 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 132/253] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:54 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:54.273731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c931e624-aeee-4e27-b529-dc93021c7455 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:54.280692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c931e624-aeee-4e27-b529-dc93021c7455 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:54.285727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c931e624-aeee-4e27-b529-dc93021c7455 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:54.286257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c931e624-aeee-4e27-b529-dc93021c7455 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:54.287164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c931e624-aeee-4e27-b529-dc93021c7455 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:54.287681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c931e624-aeee-4e27-b529-dc93021c7455 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:54.434281 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c931e624-aeee-4e27-b529-dc93021c7455 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 27936 microversion: 2.20 time: 0.164319 Jan 15 15:49:54.435431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 122/254] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:54 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 27936 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:49:55.086667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:55.087414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:55.094656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:55.095198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:55.096031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:55.096521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:55.280593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:55.287002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:55.287976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:55.288439 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c6b934d0-da3f-41f8-b0b9-b2b0c96e4918 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.205463 Jan 15 15:49:55.289052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 133/255] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:55 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:55.300711 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:55.301139 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:55.302732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:55.305329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:55.448972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ba5d888a-f6ac-4042-b6a1-1ec2230cc9c9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:55.450162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ba5d888a-f6ac-4042-b6a1-1ec2230cc9c9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:55.457416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba5d888a-f6ac-4042-b6a1-1ec2230cc9c9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:55.458170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba5d888a-f6ac-4042-b6a1-1ec2230cc9c9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:55.460106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba5d888a-f6ac-4042-b6a1-1ec2230cc9c9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:55.461065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba5d888a-f6ac-4042-b6a1-1ec2230cc9c9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:55.491125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:55.516691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-401c394a-17bc-401a-bf48-a4ed7f845db0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.233256 Jan 15 15:49:55.527653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 123/256] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:55 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:55.596120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ba5d888a-f6ac-4042-b6a1-1ec2230cc9c9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.153611 Jan 15 15:49:55.597061 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 134/257] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:55 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:49:56.310514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:56.311323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:56.324695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:56.325823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:56.326883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:56.327764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:56.701568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:56.710606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dc10ff8f-aa6d-4d18-aed7-4a5306375eee tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.409056 Jan 15 15:49:56.717341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 124/258] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:56 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:56.727418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:56.728132 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:56.738846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:56.738846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:56.738846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:56.738846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:56.741433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6afa5d68-8c1f-44f9-8da1-b3600ae216ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'create', calling method: .version_select at 0x7f2168178280>, body: {"keypair": {"name": "tempest-keypair-1969789977"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:56.758842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-6afa5d68-8c1f-44f9-8da1-b3600ae216ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:49:56.765187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-6afa5d68-8c1f-44f9-8da1-b3600ae216ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for user 9a3bb74802b3408290f26c129388df24 and project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:49:56.913274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:56.922574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c0eceedb-9364-4781-a156-51cd2de58914 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.203567 Jan 15 15:49:56.923139 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 125/259] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:56 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:56.937731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4030874a-c5a2-46d0-86a2-8f5c09e12b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:56.938837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4030874a-c5a2-46d0-86a2-8f5c09e12b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:56.945782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4030874a-c5a2-46d0-86a2-8f5c09e12b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:56.946220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4030874a-c5a2-46d0-86a2-8f5c09e12b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:56.947013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4030874a-c5a2-46d0-86a2-8f5c09e12b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:56.947713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4030874a-c5a2-46d0-86a2-8f5c09e12b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:57.013130 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4030874a-c5a2-46d0-86a2-8f5c09e12b92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.078788 Jan 15 15:49:57.017194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 126/260] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:56 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:57.217711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-6afa5d68-8c1f-44f9-8da1-b3600ae216ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:49:57.222327 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-6afa5d68-8c1f-44f9-8da1-b3600ae216ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for user 9a3bb74802b3408290f26c129388df24 and project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:49:57.242017 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6afa5d68-8c1f-44f9-8da1-b3600ae216ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.728317 Jan 15 15:49:57.242531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 135/261] 10.222.0.36 () {60 vars in 1157 bytes} [Sat Jan 15 15:49:56 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:49:57.731827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:57.732770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:57.741507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:57.741964 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:57.743011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:57.743640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:57.943566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:57.952579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:57.959773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:57.960383 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:57.961180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:57.962174 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:57.972852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:57.981389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4a026ba0-8460-4068-9c67-febd22240ded tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.258286 Jan 15 15:49:57.982570 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 127/262] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:57 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:58.027028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e70802cb-9665-41e3-84f7-38ed6a79009f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:58.029297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e70802cb-9665-41e3-84f7-38ed6a79009f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:58.043228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e70802cb-9665-41e3-84f7-38ed6a79009f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:58.044022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e70802cb-9665-41e3-84f7-38ed6a79009f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:58.045516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e70802cb-9665-41e3-84f7-38ed6a79009f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:58.046553 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e70802cb-9665-41e3-84f7-38ed6a79009f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:58.199178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e70802cb-9665-41e3-84f7-38ed6a79009f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.171688 Jan 15 15:49:58.199178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 128/263] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:58 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:49:58.223345 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:58.235792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-99dd5784-8b10-404e-9503-6d9fb4f2a138 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.298343 Jan 15 15:49:58.240203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 136/264] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:57 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:59.000539 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:59.001334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:59.011264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:59.012058 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:59.013174 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:59.013840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:59.134788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-b67c0643-5010-4d15-8f00-d18568c72a45 req-561462a6-93e4-4d75-9f70-4fdc1bc14136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dd480b-0e91-44ac-a189-bab233c60939", "name": "network-vif-plugged", "status": "completed", "tag": "4f9cced9-e62d-4dcf-ad40-ab659a7cdf1b"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:59.137977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:49:59.137977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:49:59.147201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-b67c0643-5010-4d15-8f00-d18568c72a45 req-561462a6-93e4-4d75-9f70-4fdc1bc14136 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:59.147939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-b67c0643-5010-4d15-8f00-d18568c72a45 req-561462a6-93e4-4d75-9f70-4fdc1bc14136 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:59.195998 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-b67c0643-5010-4d15-8f00-d18568c72a45 req-561462a6-93e4-4d75-9f70-4fdc1bc14136 service nova] Creating event network-vif-plugged:4f9cced9-e62d-4dcf-ad40-ab659a7cdf1b for instance 82dd480b-0e91-44ac-a189-bab233c60939 on hv-cinder-82481 Jan 15 15:49:59.202629 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-b67c0643-5010-4d15-8f00-d18568c72a45 req-561462a6-93e4-4d75-9f70-4fdc1bc14136 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071449 Jan 15 15:49:59.204396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 137/265] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:49:59.258391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c769e0eb-5de7-44e2-a0dc-74cdc3e18ab1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:49:59.267822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c769e0eb-5de7-44e2-a0dc-74cdc3e18ab1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:59.286560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c769e0eb-5de7-44e2-a0dc-74cdc3e18ab1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:59.287702 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c769e0eb-5de7-44e2-a0dc-74cdc3e18ab1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:59.290414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c769e0eb-5de7-44e2-a0dc-74cdc3e18ab1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:59.292755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c769e0eb-5de7-44e2-a0dc-74cdc3e18ab1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:59.354515 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:59.366486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-acc5f6d3-cc1e-4df5-b007-7e980192ae0e tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.372067 Jan 15 15:49:59.379099 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 129/266] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:58 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:49:59.379099 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:49:59.379099 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:49:59.398415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:59.401488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:59.402298 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c769e0eb-5de7-44e2-a0dc-74cdc3e18ab1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.192596 Jan 15 15:49:59.406378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 138/267] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:49:59 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:49:59.406555 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:49:59.407806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:49:59.699449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:49:59.715462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7f7a4513-0240-498a-890d-42c528316555 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.343350 Jan 15 15:49:59.716335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 130/268] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:49:59 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:00.389403 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:00.390148 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:00.397595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:00.398056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:00.398894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:00.399515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:00.414510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8f8124ea-d793-490c-97f7-572f4cb2e894 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:00.416771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8f8124ea-d793-490c-97f7-572f4cb2e894 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:00.434480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f8124ea-d793-490c-97f7-572f4cb2e894 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:00.435231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f8124ea-d793-490c-97f7-572f4cb2e894 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:00.436598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f8124ea-d793-490c-97f7-572f4cb2e894 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:00.437265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f8124ea-d793-490c-97f7-572f4cb2e894 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:00.511590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8f8124ea-d793-490c-97f7-572f4cb2e894 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.099031 Jan 15 15:50:00.513924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 131/269] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:00 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:00.594621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:00.605268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-83412e7a-8818-4a3a-a799-cccc8e693317 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.221464 Jan 15 15:50:00.605726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 139/270] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:00 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:00.733335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:00.734045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:00.762994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:00.763451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:00.768433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:00.768907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:00.945874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1611886306", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16a29c0f-c588-4e7a-a028-57bd992799fc"}], "security_groups": [{"name": "tempest-securitygroup--1619050789"}], "key_name": "tempest-keypair-1969789977", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:01.166713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.network.neutron [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] validate_networks() for [('16a29c0f-c588-4e7a-a028-57bd992799fc', None, None, None, None, None)] {{(pid=123221) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:50:01.177190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:01.187602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c992fcc5-8a29-4f21-a022-0640dc55ff5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1521 microversion: 2.1 time: 0.459361 Jan 15 15:50:01.188217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 132/271] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:00 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:01.524721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1f4d2e5d-1992-4fc7-801c-2d49ad82ef63 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:01.526374 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1f4d2e5d-1992-4fc7-801c-2d49ad82ef63 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:01.533206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4d2e5d-1992-4fc7-801c-2d49ad82ef63 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:01.538613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4d2e5d-1992-4fc7-801c-2d49ad82ef63 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:01.538613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4d2e5d-1992-4fc7-801c-2d49ad82ef63 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:01.538613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4d2e5d-1992-4fc7-801c-2d49ad82ef63 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:01.635970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1f4d2e5d-1992-4fc7-801c-2d49ad82ef63 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.114064 Jan 15 15:50:01.639204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 133/272] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:01 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:01.646961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:01.653024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:01.683154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:01.684158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:01.685087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:01.685775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:01.689294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Flavor limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:50:01.689816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Image limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:50:01.690187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Flavor pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:50:01.690630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Image pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:50:01.691049 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:50:01.703368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:01.709196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:01.710217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:01.710675 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:01.767938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for project 82a446d233d547a699dcdbde99a35548. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:50:01.783143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for user 9a3bb74802b3408290f26c129388df24 and project 82a446d233d547a699dcdbde99a35548. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:50:01.827788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Going to run 1 instances... {{(pid=123221) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:50:01.830195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:50:01.907309 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:01.920753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-387f1444-19f3-400b-9407-148fd34a2dc8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1314 microversion: 2.1 time: 0.278204 Jan 15 15:50:01.922308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 134/273] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:01 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:01.971451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-245586d6-2f5d-46d4-91eb-d087dab492d2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.030066 Jan 15 15:50:01.972084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 140/274] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:50:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:50:01.981795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1b832c52-8f25-4ec3-afa0-390e69906a72 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:01.982656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1b832c52-8f25-4ec3-afa0-390e69906a72 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:02.046877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1b832c52-8f25-4ec3-afa0-390e69906a72 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:02.053702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1b832c52-8f25-4ec3-afa0-390e69906a72 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1238 microversion: 2.1 time: 0.075460 Jan 15 15:50:02.054278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 135/275] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:01 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:02.205788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:02.206851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:02.217508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.217508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:02.217508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.217508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:02.387060 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:02.396619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8336852e-54e6-4738-a5e8-b925a959bfd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1501 microversion: 2.1 time: 0.195366 Jan 15 15:50:02.397190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 141/276] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:02 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:02.415177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:02.416280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:02.425875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.426577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:02.427919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.428576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:02.608557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:02.617526 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9ec0e540-f212-448d-b6f0-e7ef80d3ea11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1515 microversion: 2.1 time: 0.207818 Jan 15 15:50:02.618212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 136/277] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:02.648257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fb9b022b-a8f0-418b-b8fd-a888f5d258b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:02.654127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fb9b022b-a8f0-418b-b8fd-a888f5d258b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:02.659059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb9b022b-a8f0-418b-b8fd-a888f5d258b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.660362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb9b022b-a8f0-418b-b8fd-a888f5d258b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:02.661337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb9b022b-a8f0-418b-b8fd-a888f5d258b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.661990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb9b022b-a8f0-418b-b8fd-a888f5d258b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:02.782866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fb9b022b-a8f0-418b-b8fd-a888f5d258b5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.138125 Jan 15 15:50:02.783746 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 142/278] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:02 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:02.938141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:02.938755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:02.945973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.948610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:02.948610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:02.948610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:03.072838 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3f1e2b57-89f4-462c-bcec-d1b0c382b6e5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:03.073822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3f1e2b57-89f4-462c-bcec-d1b0c382b6e5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:03.120425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:03.128016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a28de6ba-db81-47b4-95a3-bca751fa6dd3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1498 microversion: 2.1 time: 0.193498 Jan 15 15:50:03.129210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 137/279] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:02 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:03.142636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3f1e2b57-89f4-462c-bcec-d1b0c382b6e5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:03.155506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3f1e2b57-89f4-462c-bcec-d1b0c382b6e5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1238 microversion: 2.1 time: 0.087562 Jan 15 15:50:03.157167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 143/280] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:03 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:03.795632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-65655594-5f67-4b34-94d6-eb310f2b31a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:03.797979 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-65655594-5f67-4b34-94d6-eb310f2b31a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:03.805295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65655594-5f67-4b34-94d6-eb310f2b31a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:03.805752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65655594-5f67-4b34-94d6-eb310f2b31a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:03.807549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65655594-5f67-4b34-94d6-eb310f2b31a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:03.808378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65655594-5f67-4b34-94d6-eb310f2b31a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:03.891593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-65655594-5f67-4b34-94d6-eb310f2b31a1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.100350 Jan 15 15:50:03.892975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 138/281] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:03 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:04.173169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:04.173777 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:04.180356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:04.180811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:04.181906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:04.182498 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:04.243918 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:04.251515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e53640eb-06ec-4a22-96c4-1658a65cfb6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1290 microversion: 2.1 time: 0.082233 Jan 15 15:50:04.252414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 144/282] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:04 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:04.844379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:04.845004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:04.852830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:04.855834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:04.855834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:04.855834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:04.884004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 15:50:04.904818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c7be1711-d2ee-48aa-a30a-24b076d9209e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:04.906061 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c7be1711-d2ee-48aa-a30a-24b076d9209e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:04.916312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c7be1711-d2ee-48aa-a30a-24b076d9209e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:04.916879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c7be1711-d2ee-48aa-a30a-24b076d9209e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:04.918579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c7be1711-d2ee-48aa-a30a-24b076d9209e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:04.919013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c7be1711-d2ee-48aa-a30a-24b076d9209e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:04.992609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c7be1711-d2ee-48aa-a30a-24b076d9209e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.093366 Jan 15 15:50:04.993905 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 145/283] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:04 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:05.226657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-056800af-3274-4de2-9877-56c7ec03fe0c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "DELETE /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 204 len: 0 microversion: 2.1 time: 0.386179 Jan 15 15:50:05.227425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 139/284] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 15:50:04 2022] DELETE /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 15:50:05.236349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:05.237134 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:05.243903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:05.244382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:05.245183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:05.246274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:05.268370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:05.269078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:05.284321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:05.284775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:05.285603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:05.286035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:05.367172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:05.376477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-83a42559-5966-4b00-86cc-6dd9742fb6a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1296 microversion: 2.1 time: 0.111986 Jan 15 15:50:05.377397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 140/285] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:05 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:05.437573 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:05.445002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-669893d1-55b7-46bc-834e-3c8f96d944cd tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1504 microversion: 2.1 time: 0.212677 Jan 15 15:50:05.450471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 146/286] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:05 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:05.836483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:05.837945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:05.845171 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:05.846474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:05.847673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:05.848314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:05.874000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lazy-loading 'flavor' on Instance uuid ba9275a1-4d53-4571-be72-2b4524364e4a {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:50:06.007118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e540a747-9109-4786-9c4e-8fc3c9c49163 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:06.011576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e540a747-9109-4786-9c4e-8fc3c9c49163 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:06.024058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e540a747-9109-4786-9c4e-8fc3c9c49163 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.025115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e540a747-9109-4786-9c4e-8fc3c9c49163 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.027726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e540a747-9109-4786-9c4e-8fc3c9c49163 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.028384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e540a747-9109-4786-9c4e-8fc3c9c49163 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.220129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-98a0b220-4da2-4772-9a3d-12d5dfe57653 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action" status: 200 len: 32 microversion: 2.1 time: 0.387210 Jan 15 15:50:06.220761 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 141/287] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:05 2022] POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:50:06.230822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:06.231629 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:06.238234 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.239069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.240043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.240658 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.382313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:06.390096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3f3cd504-1092-417b-961f-240d9903e610 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.163664 Jan 15 15:50:06.390821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 142/288] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:06.401427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:06.402816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:06.408535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.408976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.409772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.410203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.539054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:06.547240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-51a266a5-6d7d-4bfa-b894-854206210e93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.149237 Jan 15 15:50:06.547815 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 143/289] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:06 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:06.552003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:06.552640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:06.558142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.558683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.559466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:06.559906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:06.687798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:06.695112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-526fc076-f139-447b-a768-cdefeb2f1293 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1504 microversion: 2.1 time: 0.146316 Jan 15 15:50:06.695683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 144/290] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:06 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:07.406883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:07.407588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:07.413824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:07.414281 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:07.415048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:07.415474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:07.547188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:07.554443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-23aa2bb7-e09a-4896-8820-14427fec6e3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.151280 Jan 15 15:50:07.563373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 145/291] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:07.564859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:07.565462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:07.571147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:07.571588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:07.572394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:07.573089 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:07.717681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:07.725750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0d03cf9e-a85e-4a3d-95b1-a121a5aedb34 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.164439 Jan 15 15:50:07.726656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 146/292] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:07 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:07.731806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:07.732445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:07.738655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:07.739124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:07.740056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:07.740613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:07.900043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:07.908682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b6238d1f-345f-4432-b1cf-3d628b8b8114 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1504 microversion: 2.1 time: 0.180863 Jan 15 15:50:07.909482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 147/293] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:07 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:08.163892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-6d4f18be-bba7-4ed4-985c-b1318d0d8a03 req-09ca06b8-d843-4066-acbd-6a5f17bfc389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78be13e2-d439-46ac-9d73-637377b4af0c", "tag": "09a51e61-e1d7-4c3b-b0ea-5787e051a8e9"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:08.166161 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:08.166161 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:50:08.175066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6d4f18be-bba7-4ed4-985c-b1318d0d8a03 req-09ca06b8-d843-4066-acbd-6a5f17bfc389 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:08.175998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6d4f18be-bba7-4ed4-985c-b1318d0d8a03 req-09ca06b8-d843-4066-acbd-6a5f17bfc389 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:08.188633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-6d4f18be-bba7-4ed4-985c-b1318d0d8a03 req-09ca06b8-d843-4066-acbd-6a5f17bfc389 service nova] Creating event network-changed:09a51e61-e1d7-4c3b-b0ea-5787e051a8e9 for instance 78be13e2-d439-46ac-9d73-637377b4af0c on hv-cinder-82481 Jan 15 15:50:08.193271 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-6d4f18be-bba7-4ed4-985c-b1318d0d8a03 req-09ca06b8-d843-4066-acbd-6a5f17bfc389 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035251 Jan 15 15:50:08.194067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 148/294] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:08.572865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:08.573545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:08.579587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:08.580032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:08.580836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:08.581274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:08.710886 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:08.718592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-12f94cce-91bf-44db-8d24-c1a7473f2523 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.150320 Jan 15 15:50:08.719147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 149/295] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:08.741935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:08.742537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:08.748154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:08.748615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:08.749381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:08.749814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:08.874194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:08.881679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-443ba137-180b-45a4-94b1-09e369c05836 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.143036 Jan 15 15:50:08.882244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 150/296] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:08 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:08.926841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:08.927500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:08.934102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:08.934613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:08.935426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:08.935866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:09.075841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:09.083074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c47179de-cdc0-46e9-8f7d-8faa8c002800 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1504 microversion: 2.1 time: 0.160003 Jan 15 15:50:09.083640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 151/297] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:08 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:09.497765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e540a747-9109-4786-9c4e-8fc3c9c49163 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 3.496462 Jan 15 15:50:09.498403 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 147/298] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:05 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 3498 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:09.735597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:09.736327 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:09.742637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:09.743162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:09.744007 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:09.744471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:09.873431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:09.881026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cefaa04d-2724-4786-8272-39d236652c86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.149086 Jan 15 15:50:09.881626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 152/299] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:09.899037 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:09.899764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:09.906841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:09.907289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:09.908065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:09.908527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:10.064425 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:10.081563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d5fb92bc-ee04-4269-b019-c243d75ed379 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.184366 Jan 15 15:50:10.082362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 148/300] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:09 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:10.100182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:10.100909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:10.107561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:10.108109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:10.109019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:10.109556 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:10.241978 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:10.249909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8696dedc-4af0-4727-a1d1-b65e32ac6286 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1504 microversion: 2.1 time: 0.153528 Jan 15 15:50:10.250406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 153/301] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:10 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:10.509535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-86087d08-dad7-4db5-be21-8922b500fc28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:10.510391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-86087d08-dad7-4db5-be21-8922b500fc28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:10.517352 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86087d08-dad7-4db5-be21-8922b500fc28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:10.517811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86087d08-dad7-4db5-be21-8922b500fc28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:10.518593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86087d08-dad7-4db5-be21-8922b500fc28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:10.519032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86087d08-dad7-4db5-be21-8922b500fc28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:10.608099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-86087d08-dad7-4db5-be21-8922b500fc28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.102229 Jan 15 15:50:10.609060 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 149/302] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:10 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:10.897716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:10.898355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:10.904705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:10.905157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:10.905942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:10.906380 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.037455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:11.053744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c675aca7-2795-418a-951f-8d74e5969cea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.159442 Jan 15 15:50:11.054994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 154/303] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:11.100207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:11.101256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:11.109368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:11.110021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.111168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:11.112101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.266723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:11.267403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:11.274738 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:11.280361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.280361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:11.280361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.282427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:11.289909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8ca4305f-1ada-4202-be68-442f3206db57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.194838 Jan 15 15:50:11.290715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 150/304] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:11 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:11.426872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:11.434696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3f1cc26a-ca61-4318-962e-7c4d1933e6eb tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1504 microversion: 2.1 time: 0.171567 Jan 15 15:50:11.436576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 155/305] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:11 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:11.549147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-a2c689ee-4a8c-4152-a68f-4301222bb7c0 req-6317dbbf-5b4e-4bdf-8e2c-0bc1bc36e393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dd480b-0e91-44ac-a189-bab233c60939", "name": "network-vif-deleted", "tag": "4f9cced9-e62d-4dcf-ad40-ab659a7cdf1b"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:11.551395 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:11.551395 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:50:11.559790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-a2c689ee-4a8c-4152-a68f-4301222bb7c0 req-6317dbbf-5b4e-4bdf-8e2c-0bc1bc36e393 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:11.560363 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-a2c689ee-4a8c-4152-a68f-4301222bb7c0 req-6317dbbf-5b4e-4bdf-8e2c-0bc1bc36e393 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.571949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-a2c689ee-4a8c-4152-a68f-4301222bb7c0 req-6317dbbf-5b4e-4bdf-8e2c-0bc1bc36e393 service nova] Creating event network-vif-deleted:4f9cced9-e62d-4dcf-ad40-ab659a7cdf1b for instance 82dd480b-0e91-44ac-a189-bab233c60939 on hv-cinder-82481 Jan 15 15:50:11.577617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-a2c689ee-4a8c-4152-a68f-4301222bb7c0 req-6317dbbf-5b4e-4bdf-8e2c-0bc1bc36e393 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Jan 15 15:50:11.578266 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 151/306] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:11.619075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ebe1f556-5b5c-47c6-b97d-3b678c87275f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:11.619974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ebe1f556-5b5c-47c6-b97d-3b678c87275f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:11.626994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1f556-5b5c-47c6-b97d-3b678c87275f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:11.627439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1f556-5b5c-47c6-b97d-3b678c87275f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.628275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1f556-5b5c-47c6-b97d-3b678c87275f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:11.628710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1f556-5b5c-47c6-b97d-3b678c87275f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:11.744799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ebe1f556-5b5c-47c6-b97d-3b678c87275f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.129367 Jan 15 15:50:11.745945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 156/307] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:11 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:12.071825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:12.072554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:12.079217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.079674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.080512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.080953 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.217498 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:12.225429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-54ed0f87-23a5-4855-99c9-3b581024c42e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.157617 Jan 15 15:50:12.226019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 152/308] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:12.240419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1870529967", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "c45c3231-9506-476f-9c55-395cb3f08cf5"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:12.291639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] validate_networks() for [('c45c3231-9506-476f-9c55-395cb3f08cf5', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:50:12.311407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:12.312043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:12.318108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.318560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.319349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.319852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.535040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:12.542501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ebc9fa3b-c7fa-475f-8bd4-8d3963abe972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.235208 Jan 15 15:50:12.555287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 153/309] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:12 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:12.560675 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:12.562007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:12.567857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.568458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.569517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.570051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.610766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.611244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.611715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.objects.instance [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lazy-loading 'fault' on Instance uuid 82dd480b-0e91-44ac-a189-bab233c60939 {{(pid=123221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:50:12.660955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:12.669964 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-dffa2c46-fb42-4a20-a24e-d2bee37a2cdc tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 200 len: 1304 microversion: 2.1 time: 0.124526 Jan 15 15:50:12.673828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 154/310] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:12 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:12.754534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:50:12.754534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:50:12.754534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:50:12.754534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:50:12.754534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:50:12.762961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.763273 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-41ef18bc-d7f0-4774-ad0a-7c7b99e8ceb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:12.763411 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.764428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.764613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-41ef18bc-d7f0-4774-ad0a-7c7b99e8ceb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:12.764866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.770886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41ef18bc-d7f0-4774-ad0a-7c7b99e8ceb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.771439 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41ef18bc-d7f0-4774-ad0a-7c7b99e8ceb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.772394 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41ef18bc-d7f0-4774-ad0a-7c7b99e8ceb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:12.772921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41ef18bc-d7f0-4774-ad0a-7c7b99e8ceb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:12.784930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Getting quotas for project 4121a00783af445eafdcb3f976604c63. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:50:12.788823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Getting quotas for user 99a03f52dc174b96b3612476a35f3833 and project 4121a00783af445eafdcb3f976604c63. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:50:12.800485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:50:12.802977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:50:12.999507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-55e55171-8b25-41cd-ace1-1c2d7ed1892b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763053 Jan 15 15:50:13.000074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 157/311] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:50:13.009547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d85e8193-8cb3-44a8-95b9-d58db5512209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:13.010163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d85e8193-8cb3-44a8-95b9-d58db5512209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:13.010286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-41ef18bc-d7f0-4774-ad0a-7c7b99e8ceb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.250853 Jan 15 15:50:13.012046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 155/312] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:12 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:13.065380 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d85e8193-8cb3-44a8-95b9-d58db5512209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:13.071314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d85e8193-8cb3-44a8-95b9-d58db5512209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1219 microversion: 2.1 time: 0.065314 Jan 15 15:50:13.071881 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 158/313] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:13 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:13.243946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:13.244681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:13.252411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:13.252780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:13.253578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:13.254030 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:13.388598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:13.396036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0ef19372-7fef-46ee-a7f1-aca69caf1e83 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.156482 Jan 15 15:50:13.396637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 156/314] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:13.562755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:13.563602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:13.572179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:13.572913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:13.574077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:13.574982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:13.690798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:13.691597 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 82dd480b-0e91-44ac-a189-bab233c60939] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:13.697773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:13.698287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:13.699132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:13.700351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:13.707105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:13.714225 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c9254921-3763-4e31-9da9-5748579d13d9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.155319 Jan 15 15:50:13.715017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 159/315] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:13 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:13.715194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] HTTP exception thrown: Instance 82dd480b-0e91-44ac-a189-bab233c60939 could not be found. Jan 15 15:50:13.715918 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Returning 404 to user: Instance 82dd480b-0e91-44ac-a189-bab233c60939 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:50:13.716878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cd8b267f-fa42-471b-b237-9693b43e99db tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939" status: 404 len: 111 microversion: 2.1 time: 0.030654 Jan 15 15:50:13.717419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 157/316] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:13 2022] GET /compute/v2.1/servers/82dd480b-0e91-44ac-a189-bab233c60939 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:50:13.816177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-437684513", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "d059c46f-e9ac-4afd-b199-b7dfd54e46e5"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:13.865891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] validate_networks() for [('d059c46f-e9ac-4afd-b199-b7dfd54e46e5', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:50:14.023238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9e15e847-fe9f-48ef-a59e-5b9be826dc97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:14.024443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9e15e847-fe9f-48ef-a59e-5b9be826dc97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:14.031491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15e847-fe9f-48ef-a59e-5b9be826dc97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.038743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15e847-fe9f-48ef-a59e-5b9be826dc97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.039808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15e847-fe9f-48ef-a59e-5b9be826dc97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.040435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15e847-fe9f-48ef-a59e-5b9be826dc97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.190959 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9e15e847-fe9f-48ef-a59e-5b9be826dc97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.169936 Jan 15 15:50:14.195009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 158/317] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:14 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:14.200734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:14.201430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:14.210144 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.210595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.211385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.211821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.304714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:14.313727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-eb4e66d0-ec0c-4452-8323-cb03f46a07a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1223 microversion: 2.1 time: 0.116892 Jan 15 15:50:14.314307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 159/318] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:14 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:14.321104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:50:14.321104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:50:14.321104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:50:14.321104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:50:14.321104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:50:14.337340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.338034 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.338922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.339357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.357194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Getting quotas for project 7848167bcae046ed80e861268575fcb1. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:50:14.361108 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Getting quotas for user 2f6cb0d17d33488e8f8ac79b9a764d90 and project 7848167bcae046ed80e861268575fcb1. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:50:14.372349 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:50:14.374731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:50:14.413756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:14.414371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:14.421988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.422446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.423398 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.423846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.530363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ddba846-8103-483b-9bba-e277f6f13d05 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717830 Jan 15 15:50:14.536910 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 160/319] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:50:14.544275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9b3f7226-fd55-4a0a-82ef-d90b308928c8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:14.545160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9b3f7226-fd55-4a0a-82ef-d90b308928c8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:14.615656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9b3f7226-fd55-4a0a-82ef-d90b308928c8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:14.624028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9b3f7226-fd55-4a0a-82ef-d90b308928c8 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1213 microversion: 2.1 time: 0.084447 Jan 15 15:50:14.635540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:14.635656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 161/320] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:14 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:14.641059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2b36c2db-2d37-43c4-81d7-7669afef993a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.230842 Jan 15 15:50:14.641635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 160/321] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:14.732001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:14.732652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:14.742188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.742188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:14.742188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:14.742188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.049156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:15.056270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-81d1a7c7-ebcf-41c8-8e17-65b283b6e967 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.328541 Jan 15 15:50:15.056873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 162/322] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:14 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:15.203430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b7b50506-b761-4bd5-9c82-47fb37656a34 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:15.204460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b7b50506-b761-4bd5-9c82-47fb37656a34 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:15.210814 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7b50506-b761-4bd5-9c82-47fb37656a34 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.211263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7b50506-b761-4bd5-9c82-47fb37656a34 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.212073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7b50506-b761-4bd5-9c82-47fb37656a34 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.212789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7b50506-b761-4bd5-9c82-47fb37656a34 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.305951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b7b50506-b761-4bd5-9c82-47fb37656a34 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.100575 Jan 15 15:50:15.305951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 161/323] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:15 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:15.336012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:15.336786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:15.344294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.345014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.346069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.346752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.416361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:15.427892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-94380a9e-c56e-4dae-961d-b631c0ffd2b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1279 microversion: 2.1 time: 0.095016 Jan 15 15:50:15.429880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 163/324] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:15 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:15.641914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:15.646063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:15.656961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.657430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.658384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:15.658993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:15.660644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.661099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.681000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.681466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.682287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:15.691835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:15.806446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:15.817739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8e834c01-341f-4705-a9df-817850b4fb92 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1217 microversion: 2.1 time: 0.180048 Jan 15 15:50:15.818330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 162/325] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:15 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:15.901589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:15.910199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-15a464d6-532d-4e1d-9278-5ff47bd9f543 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.255664 Jan 15 15:50:15.910783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 164/326] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:16.072935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:16.073758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:16.081382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.081836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.082865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.083408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.220919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:16.235897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-989b2177-f3d2-4499-bc88-51f96df8b58c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.166470 Jan 15 15:50:16.236773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 163/327] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:16 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:16.313741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8bbb09de-7be3-4116-99ae-038de8b1a0a2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:16.314515 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8bbb09de-7be3-4116-99ae-038de8b1a0a2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:16.321257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bbb09de-7be3-4116-99ae-038de8b1a0a2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.321710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bbb09de-7be3-4116-99ae-038de8b1a0a2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.322687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bbb09de-7be3-4116-99ae-038de8b1a0a2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.323133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bbb09de-7be3-4116-99ae-038de8b1a0a2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.426337 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8bbb09de-7be3-4116-99ae-038de8b1a0a2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.119009 Jan 15 15:50:16.427266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 165/328] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:16 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:16.447690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:16.448649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:16.455508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.456032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.456867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.457323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.607028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:16.615256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aff10a52-64b4-4387-8933-489c7819eddd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.171154 Jan 15 15:50:16.615829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 164/329] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:16 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:16.836667 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:16.838264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:16.846461 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.847065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.848091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.848604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.927316 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:16.928348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:16.929264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:16.935562 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.938414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1e599306-567f-41be-8632-f34cfa9994f4 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1273 microversion: 2.1 time: 0.106387 Jan 15 15:50:16.948697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.948697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:16.948697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:16.949650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 166/330] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:16 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:17.126682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:17.136060 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-67c330ae-dd7d-491b-be73-b2bc88721957 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.212547 Jan 15 15:50:17.161695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 165/331] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:17.255574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:17.257008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:17.271744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.272751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.273807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.274403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.448132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0e26fcb6-042d-469d-affa-52d5890ffa0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:17.453384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0e26fcb6-042d-469d-affa-52d5890ffa0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:17.477296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e26fcb6-042d-469d-affa-52d5890ffa0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.478091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e26fcb6-042d-469d-affa-52d5890ffa0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.479404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e26fcb6-042d-469d-affa-52d5890ffa0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.481891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e26fcb6-042d-469d-affa-52d5890ffa0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.590724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:17.610618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0e26fcb6-042d-469d-affa-52d5890ffa0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28170 microversion: 2.20 time: 0.168689 Jan 15 15:50:17.611265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 166/332] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:17 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28170 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:17.620417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c19114f2-a4ce-4345-8f7c-84d0db337719 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.368032 Jan 15 15:50:17.621623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 167/333] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:17 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:17.623300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-e787b0a1-e150-49c1-b23f-ab6f79f00156 req-c8a4c9ed-af44-4cfb-8bac-5a3a1b35bbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0", "tag": "4a1a9294-08f3-4060-8d7f-017bd388f212"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:17.630296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:17.630296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:50:17.634320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:17.641115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:17.642802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.643915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.645659 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.646350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.647662 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-e787b0a1-e150-49c1-b23f-ab6f79f00156 req-c8a4c9ed-af44-4cfb-8bac-5a3a1b35bbf9 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.648119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-e787b0a1-e150-49c1-b23f-ab6f79f00156 req-c8a4c9ed-af44-4cfb-8bac-5a3a1b35bbf9 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.662075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-e787b0a1-e150-49c1-b23f-ab6f79f00156 req-c8a4c9ed-af44-4cfb-8bac-5a3a1b35bbf9 service nova] Creating event network-changed:4a1a9294-08f3-4060-8d7f-017bd388f212 for instance 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 on hv-cinder-82481 Jan 15 15:50:17.668780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-e787b0a1-e150-49c1-b23f-ab6f79f00156 req-c8a4c9ed-af44-4cfb-8bac-5a3a1b35bbf9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055997 Jan 15 15:50:17.678507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 167/334] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:17.814517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:17.822853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fc1c131d-57bc-4be4-ac8d-c40f0bbb7df1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.193671 Jan 15 15:50:17.833911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 168/335] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:17 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:17.920870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-1e37130a-a7de-4a6a-ad13-94a53df29f84 req-20fe9756-0e24-4859-a462-3eb716e8e78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78be13e2-d439-46ac-9d73-637377b4af0c", "name": "network-vif-plugged", "status": "completed", "tag": "09a51e61-e1d7-4c3b-b0ea-5787e051a8e9"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:17.920870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:17.920870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:50:17.926858 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-1e37130a-a7de-4a6a-ad13-94a53df29f84 req-20fe9756-0e24-4859-a462-3eb716e8e78c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.927343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-1e37130a-a7de-4a6a-ad13-94a53df29f84 req-20fe9756-0e24-4859-a462-3eb716e8e78c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.939496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-1e37130a-a7de-4a6a-ad13-94a53df29f84 req-20fe9756-0e24-4859-a462-3eb716e8e78c service nova] Creating event network-vif-plugged:09a51e61-e1d7-4c3b-b0ea-5787e051a8e9 for instance 78be13e2-d439-46ac-9d73-637377b4af0c on hv-cinder-82481 Jan 15 15:50:17.945113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-1e37130a-a7de-4a6a-ad13-94a53df29f84 req-20fe9756-0e24-4859-a462-3eb716e8e78c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033225 Jan 15 15:50:17.946867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 168/336] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:17.956078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:17.956750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:17.966267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.967836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:17.976447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:17.976447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.163603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:18.165381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:18.175672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.176119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.176939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.180539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.212858 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:18.228080 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c8535e41-5366-4300-b906-9ecc1658c8c0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.275585 Jan 15 15:50:18.241010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 169/337] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:17 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:18.427317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:18.435321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a02670f7-d079-40ec-b479-808d47d37d51 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.276025 Jan 15 15:50:18.435819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 169/338] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:18.623627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-561db520-6dfe-485a-9f9b-5d8f07b468f3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:18.624673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-561db520-6dfe-485a-9f9b-5d8f07b468f3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:18.630909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-561db520-6dfe-485a-9f9b-5d8f07b468f3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.631364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-561db520-6dfe-485a-9f9b-5d8f07b468f3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.632254 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-561db520-6dfe-485a-9f9b-5d8f07b468f3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.632990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-561db520-6dfe-485a-9f9b-5d8f07b468f3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.638219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:18.639165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:18.649028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.649028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.652477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.653170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.809035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:18.819070 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-892cdddf-8130-4657-b10f-83a9fed9df92 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.185162 Jan 15 15:50:18.819645 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 170/339] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:18 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:18.845739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:18.846618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:18.854559 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.855701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.857053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:18.858531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:18.859147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-561db520-6dfe-485a-9f9b-5d8f07b468f3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28363 microversion: 2.20 time: 0.239484 Jan 15 15:50:18.859912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 170/340] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:18 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:19.024846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:19.036676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7e0be4b3-075f-4d53-8a5f-1774d37fe558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.198276 Jan 15 15:50:19.047467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 171/341] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:18 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:19.248568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:19.260008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:19.260008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.260008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.260008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.260427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.395777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:19.403409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6b8daa9e-74fd-4c52-b55b-f5c70b967a90 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.161440 Jan 15 15:50:19.404071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 171/342] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:19 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:19.457610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:19.458608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:19.469724 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.470260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.471167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.471690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.620186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:19.628056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-798fc97c-bcda-4c9d-928d-c9bef770915f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.175690 Jan 15 15:50:19.628666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 172/343] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:19.801817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-693728b6-ede2-44bf-abd1-fcee6c6e68d9 req-4c4e82b6-7256-45e3-89b1-e0d2c329ccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598b39b5-9a61-4502-9e45-1a4ad248e828", "tag": "907637c6-d745-48ee-88b6-2f0c86bbe725"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:19.807438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:19.807438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:50:19.829118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-693728b6-ede2-44bf-abd1-fcee6c6e68d9 req-4c4e82b6-7256-45e3-89b1-e0d2c329ccb1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.830565 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-693728b6-ede2-44bf-abd1-fcee6c6e68d9 req-4c4e82b6-7256-45e3-89b1-e0d2c329ccb1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.837474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:19.838079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:19.851859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.852337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.853423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.857214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.887111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-693728b6-ede2-44bf-abd1-fcee6c6e68d9 req-4c4e82b6-7256-45e3-89b1-e0d2c329ccb1 service nova] Creating event network-changed:907637c6-d745-48ee-88b6-2f0c86bbe725 for instance 598b39b5-9a61-4502-9e45-1a4ad248e828 on hv-cinder-82481 Jan 15 15:50:19.901348 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-693728b6-ede2-44bf-abd1-fcee6c6e68d9 req-4c4e82b6-7256-45e3-89b1-e0d2c329ccb1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103588 Jan 15 15:50:19.904644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 172/344] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:50:19.916992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-455d4980-8ddc-4cc1-a63e-eb28ccaafa1a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:19.923173 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-455d4980-8ddc-4cc1-a63e-eb28ccaafa1a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:19.938655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-455d4980-8ddc-4cc1-a63e-eb28ccaafa1a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.939395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-455d4980-8ddc-4cc1-a63e-eb28ccaafa1a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:19.940394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-455d4980-8ddc-4cc1-a63e-eb28ccaafa1a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:19.941134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-455d4980-8ddc-4cc1-a63e-eb28ccaafa1a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:20.062459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:20.069932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aec3e9d3-3f80-4e26-8a74-e09ba1208ee5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1364 microversion: 2.1 time: 0.236377 Jan 15 15:50:20.070572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 173/345] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:19 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:20.075803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:20.076659 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:20.082985 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:20.083497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:20.084329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:20.084771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:20.143854 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-455d4980-8ddc-4cc1-a63e-eb28ccaafa1a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28461 microversion: 2.20 time: 0.237050 Jan 15 15:50:20.144689 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 173/346] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:19 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28461 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:20.248609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:20.257229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fcd56f4a-7ab2-4a6f-b8f7-b469986c1b71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.185252 Jan 15 15:50:20.257827 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 174/347] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:20 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:20.421882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:20.423475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:20.430148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:20.430666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:20.431513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:20.432030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:20.598822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:20.606995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2049b125-77f0-4d6e-be87-0f0015df4ef0 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.190329 Jan 15 15:50:20.607554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 174/348] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:20 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:20.645412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:20.651329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:20.653078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:20.653731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:20.654519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:20.654956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:20.798092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:20.806372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0942497d-202a-4369-aedb-4d1d450f1088 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.164664 Jan 15 15:50:20.806826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:21.086599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:21.087282 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:21.095148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.096428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.096702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.097152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.156240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-da3d6006-0527-4fa4-b2d6-f2dbbe2f9e28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:21.157466 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-da3d6006-0527-4fa4-b2d6-f2dbbe2f9e28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:21.167490 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da3d6006-0527-4fa4-b2d6-f2dbbe2f9e28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.168424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da3d6006-0527-4fa4-b2d6-f2dbbe2f9e28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.169899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da3d6006-0527-4fa4-b2d6-f2dbbe2f9e28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.170816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da3d6006-0527-4fa4-b2d6-f2dbbe2f9e28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.249492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:21.257410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ad20ff0-7cca-4fc3-8aa2-004935246d41 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1550 microversion: 2.1 time: 0.174489 Jan 15 15:50:21.258039 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 175/350] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:21 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:21.279314 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-da3d6006-0527-4fa4-b2d6-f2dbbe2f9e28 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28529 microversion: 2.20 time: 0.127465 Jan 15 15:50:21.280079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 176/351] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:21 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28529 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:21.284386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:21.285093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:21.285286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b4d188c8-4a84-4b63-9935-77b5e8592e0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:21.285888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b4d188c8-4a84-4b63-9935-77b5e8592e0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:21.291758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.292305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.293156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d188c8-4a84-4b63-9935-77b5e8592e0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.293609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d188c8-4a84-4b63-9935-77b5e8592e0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.293860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.294405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d188c8-4a84-4b63-9935-77b5e8592e0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.294691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.295006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d188c8-4a84-4b63-9935-77b5e8592e0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.408958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b4d188c8-4a84-4b63-9935-77b5e8592e0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127368 Jan 15 15:50:21.409622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 177/352] 10.222.0.36 () {58 vars in 1274 bytes} [Sat Jan 15 15:50:21 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:21.563244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:21.571069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e8d05110-1f39-4e01-8413-22cb7d3ceba5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.299860 Jan 15 15:50:21.571637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 176/353] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:21 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:21.625957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:21.626569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:21.632778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.633263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.634121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.634557 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.824395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:21.825911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:21.832880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.833425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.834505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:21.835042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:21.957419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:21.967816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9174631b-49b6-495c-bced-8f5b8ec78716 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.347701 Jan 15 15:50:21.968890 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 178/354] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:21 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:22.109396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:22.116617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ecd68391-f568-4daa-a69e-9e99361b2d15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.296492 Jan 15 15:50:22.117184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 177/355] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:22.291172 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-be04d4ad-0a9b-4ff1-9e78-3aa1402c7690 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:22.292051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-be04d4ad-0a9b-4ff1-9e78-3aa1402c7690 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:22.299416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be04d4ad-0a9b-4ff1-9e78-3aa1402c7690 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.299878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be04d4ad-0a9b-4ff1-9e78-3aa1402c7690 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.300711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be04d4ad-0a9b-4ff1-9e78-3aa1402c7690 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.301155 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be04d4ad-0a9b-4ff1-9e78-3aa1402c7690 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.411416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-be04d4ad-0a9b-4ff1-9e78-3aa1402c7690 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.123889 Jan 15 15:50:22.412382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 179/356] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:22 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:22.588535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:22.589308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:22.596653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.597180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.598063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.598573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.844165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:22.851700 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c091e264-1bb2-4015-9720-d5a53b1ed451 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.267247 Jan 15 15:50:22.853965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 178/357] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:22 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:22.896325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c30200ba-80b3-41f3-a2a4-c11da9bb31db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:22.897738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c30200ba-80b3-41f3-a2a4-c11da9bb31db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:22.905583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-fd73150b-b177-4d0d-a57e-04e584bb3204 req-fa132e55-407c-4606-8e88-1897da2b909a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78be13e2-d439-46ac-9d73-637377b4af0c", "tag": "09a51e61-e1d7-4c3b-b0ea-5787e051a8e9"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:22.905583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:22.905583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:50:22.908169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c30200ba-80b3-41f3-a2a4-c11da9bb31db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.909560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c30200ba-80b3-41f3-a2a4-c11da9bb31db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.910577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c30200ba-80b3-41f3-a2a4-c11da9bb31db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.910868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-fd73150b-b177-4d0d-a57e-04e584bb3204 req-fa132e55-407c-4606-8e88-1897da2b909a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.911320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-fd73150b-b177-4d0d-a57e-04e584bb3204 req-fa132e55-407c-4606-8e88-1897da2b909a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.911678 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c30200ba-80b3-41f3-a2a4-c11da9bb31db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.923291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-fd73150b-b177-4d0d-a57e-04e584bb3204 req-fa132e55-407c-4606-8e88-1897da2b909a service nova] Creating event network-changed:09a51e61-e1d7-4c3b-b0ea-5787e051a8e9 for instance 78be13e2-d439-46ac-9d73-637377b4af0c on hv-cinder-82481 Jan 15 15:50:22.928681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-fd73150b-b177-4d0d-a57e-04e584bb3204 req-fa132e55-407c-4606-8e88-1897da2b909a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034140 Jan 15 15:50:22.929510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 179/358] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:22.987494 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:22.988438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:22.995445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.996933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:22.997926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:22.998544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:23.039503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c30200ba-80b3-41f3-a2a4-c11da9bb31db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 14 microversion: 2.1 time: 0.150278 Jan 15 15:50:23.043897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 180/359] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:22 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:50:23.139144 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:23.140011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:23.162745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:23.163238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:23.164055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:23.164776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:23.254573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:23.263800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2a7c3b3e-46cd-4b7a-9bf9-04f7ab2fa6af tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.280649 Jan 15 15:50:23.275770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 180/360] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:22 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:23.344095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:23.351666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-705510e6-44f8-46ad-94ff-a945068b9477 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.220617 Jan 15 15:50:23.352889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 181/361] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:23.424633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-74a76fb4-ab7c-4364-964f-e2c6ef963311 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:23.426001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-74a76fb4-ab7c-4364-964f-e2c6ef963311 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:23.435441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74a76fb4-ab7c-4364-964f-e2c6ef963311 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:23.436237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74a76fb4-ab7c-4364-964f-e2c6ef963311 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:23.439336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74a76fb4-ab7c-4364-964f-e2c6ef963311 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:23.440346 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74a76fb4-ab7c-4364-964f-e2c6ef963311 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:23.702495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-74a76fb4-ab7c-4364-964f-e2c6ef963311 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.197630 Jan 15 15:50:23.702495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 181/362] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:23 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:23.870320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:23.872034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:23.882545 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:23.885557 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:23.887468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:23.889615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.053171 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-927d972b-1317-4cc3-9d1c-b0c487e10474 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:24.054276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-927d972b-1317-4cc3-9d1c-b0c487e10474 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:24.064722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-927d972b-1317-4cc3-9d1c-b0c487e10474 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.072300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-927d972b-1317-4cc3-9d1c-b0c487e10474 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.072300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-927d972b-1317-4cc3-9d1c-b0c487e10474 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.072300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-927d972b-1317-4cc3-9d1c-b0c487e10474 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.135808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:24.145064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-457a1bae-8f97-4d0e-9b53-2a0fce1d9ccb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.278487 Jan 15 15:50:24.145647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 182/363] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:23 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:24.280642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:24.281265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:24.287369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.287823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.288649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.289096 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.422444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:24.429585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e24197cd-3c40-4995-aa9e-165b6200eea5 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.152799 Jan 15 15:50:24.430167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 183/364] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:24 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:24.434983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:24.435596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:24.440982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.441458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.442215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.442653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.573250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:24.581046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-69307716-8b0f-46a0-aa56-4c940632bb1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.149969 Jan 15 15:50:24.581605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 184/365] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:24.629576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7f9af360-2324-4659-b020-1e77be843faa tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:24.630560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7f9af360-2324-4659-b020-1e77be843faa tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:24.636444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f9af360-2324-4659-b020-1e77be843faa tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.637501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f9af360-2324-4659-b020-1e77be843faa tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.638380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f9af360-2324-4659-b020-1e77be843faa tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:24.638919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f9af360-2324-4659-b020-1e77be843faa tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:24.702733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-927d972b-1317-4cc3-9d1c-b0c487e10474 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 14 microversion: 2.1 time: 0.653435 Jan 15 15:50:24.703535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 182/366] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:24 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 14 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:50:24.729453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7f9af360-2324-4659-b020-1e77be843faa tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.103417 Jan 15 15:50:24.730101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 185/367] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:24 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:25.163415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:25.164694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:25.172968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.173422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.174220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.174657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.318001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:25.325634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-53391332-5222-4d57-9274-a20cd7abf9f6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.166967 Jan 15 15:50:25.326194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 183/368] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:25 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:25.447066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:25.447871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:25.455195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.455652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.456462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.456898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.592381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:25.598182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:25.598730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:25.600131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b436aa4f-3db7-4f4e-9cb8-558463dae4a9 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.157140 Jan 15 15:50:25.600881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 186/369] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:25 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:25.606330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.606785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.607584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.608017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.713340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b401f650-42a2-4717-9663-210ee65785a7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:25.714299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b401f650-42a2-4717-9663-210ee65785a7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:25.721283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b401f650-42a2-4717-9663-210ee65785a7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.721813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b401f650-42a2-4717-9663-210ee65785a7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.722512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b401f650-42a2-4717-9663-210ee65785a7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.722946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b401f650-42a2-4717-9663-210ee65785a7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.744803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:25.752111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-73f4d871-be06-4f9c-9bf3-131116ce75e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.157581 Jan 15 15:50:25.752718 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 184/370] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:25.757051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-96f44138-874a-43ff-98db-ac0022717e47 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:25.757948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-96f44138-874a-43ff-98db-ac0022717e47 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:25.763635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f44138-874a-43ff-98db-ac0022717e47 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.764085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f44138-874a-43ff-98db-ac0022717e47 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:25.764884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f44138-874a-43ff-98db-ac0022717e47 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:25.765323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-96f44138-874a-43ff-98db-ac0022717e47 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:30.374746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-96f44138-874a-43ff-98db-ac0022717e47 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 4.620778 Jan 15 15:50:30.375556 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 185/371] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:25 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 4622 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:30.381314 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b401f650-42a2-4717-9663-210ee65785a7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 14 microversion: 2.1 time: 4.671461 Jan 15 15:50:30.384484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 187/372] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:25 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 14 bytes in 4673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 15:50:30.394261 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:30.394972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:30.398389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:30.399124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:30.402887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:30.403343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:30.404267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:30.404713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:30.405929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:30.406390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:30.407219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:30.407654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:30.618782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:30.619004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:30.627245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-483690a2-76fc-439e-ad8b-fb170933fed5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.243736 Jan 15 15:50:30.627464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-27be2fbb-cefb-4539-b39c-8f581b40536c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.237468 Jan 15 15:50:30.627815 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 186/373] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:30 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:30.632497 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:30.633226 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:30.638315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 188/374] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:30 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:30.640349 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:30.640800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:30.641580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:30.642001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:30.771406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:30.778589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d56d1512-8ec3-46bc-8064-e134d4656cd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.149794 Jan 15 15:50:30.779124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 187/375] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:31.386938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-75b0683a-55bb-478f-b370-4aa67003bc9f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:31.388133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-75b0683a-55bb-478f-b370-4aa67003bc9f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:31.392941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f76994dd-0596-4583-8034-af30488e8d01 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:31.393916 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f76994dd-0596-4583-8034-af30488e8d01 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:31.395875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-75b0683a-55bb-478f-b370-4aa67003bc9f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:31.396382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-75b0683a-55bb-478f-b370-4aa67003bc9f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:31.397206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-75b0683a-55bb-478f-b370-4aa67003bc9f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:31.397628 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-75b0683a-55bb-478f-b370-4aa67003bc9f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:31.400381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f76994dd-0596-4583-8034-af30488e8d01 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:31.400833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f76994dd-0596-4583-8034-af30488e8d01 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:31.402980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f76994dd-0596-4583-8034-af30488e8d01 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:31.402980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f76994dd-0596-4583-8034-af30488e8d01 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:35.834683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-75b0683a-55bb-478f-b370-4aa67003bc9f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 4.451704 Jan 15 15:50:35.835441 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 189/376] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:31 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 4453 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:35.836063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f76994dd-0596-4583-8034-af30488e8d01 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 14 microversion: 2.1 time: 4.446615 Jan 15 15:50:35.836738 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 188/377] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:31 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 14 bytes in 4448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 15:50:35.841767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:35.842009 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:35.842556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:35.842712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:35.849879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:35.850321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:35.851121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:35.851591 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:35.851699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:35.852093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:35.852914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:35.853355 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:36.048091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:36.057898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:36.059642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bffb7db8-61ce-42af-bfea-4d5e03477460 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.222243 Jan 15 15:50:36.060371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 190/378] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:35 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:36.065972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:36.066705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b49c95a4-4bdb-4c1d-a9e8-d31c69a2c28f tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.228798 Jan 15 15:50:36.066935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:36.067495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 189/379] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:35 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:36.073378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:36.074019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:36.074952 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:36.075387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:36.206605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:36.213792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2dbe4a6a-d143-4cd6-8f54-c5e8fb6a6f88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1521 microversion: 2.1 time: 0.152224 Jan 15 15:50:36.214863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 191/380] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:36.847683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ad8c7bfa-5493-4cae-952f-c347b3751491 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:36.848621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ad8c7bfa-5493-4cae-952f-c347b3751491 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:36.848859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-28b4be39-4484-445f-aecb-582525bdff64 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:36.849807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-28b4be39-4484-445f-aecb-582525bdff64 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:36.854860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8c7bfa-5493-4cae-952f-c347b3751491 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:36.855303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8c7bfa-5493-4cae-952f-c347b3751491 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:36.856146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8c7bfa-5493-4cae-952f-c347b3751491 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:36.856512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28b4be39-4484-445f-aecb-582525bdff64 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:36.856913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8c7bfa-5493-4cae-952f-c347b3751491 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:36.857023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28b4be39-4484-445f-aecb-582525bdff64 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:36.857728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28b4be39-4484-445f-aecb-582525bdff64 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:36.858171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-28b4be39-4484-445f-aecb-582525bdff64 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:36.991668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-28b4be39-4484-445f-aecb-582525bdff64 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.146242 Jan 15 15:50:36.993005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 192/381] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:36 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:36.993457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ad8c7bfa-5493-4cae-952f-c347b3751491 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 14 microversion: 2.1 time: 0.149280 Jan 15 15:50:36.994610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 190/382] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:36 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:50:37.082361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:37.087813 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:37.088875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:37.092778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:37.099598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.100051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.100874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.101314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.108490 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.108949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.109753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.110198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.318073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:37.321316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:37.326744 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2003ba1f-44c5-484a-8d5f-61e0877d4644 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.247534 Jan 15 15:50:37.327334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 193/383] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:37 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:37.332170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:37.333156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:37.333947 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ac6053b5-88e9-4381-964e-30940b367be3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.249977 Jan 15 15:50:37.334751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 191/384] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:37 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:37.339237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.339724 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.340680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.341497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.484309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:37.489550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-80dcdc85-042b-4a9c-8a5e-cd49b173b6c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1501 microversion: 2.1 time: 0.160838 Jan 15 15:50:37.490203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 194/385] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:37.507604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12cd48bd-8adf-44fe-bf4d-c8d2277aedfa"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:37.508872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:37.515877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.516356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.517140 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.517573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.540882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] HTTP exception thrown: Cannot 'attach_volume' instance ba9275a1-4d53-4571-be72-2b4524364e4a while it is in vm_state rescued Jan 15 15:50:37.541475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Returning 409 to user: Cannot 'attach_volume' instance ba9275a1-4d53-4571-be72-2b4524364e4a while it is in vm_state rescued {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:50:37.542303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2cc51e17-8196-4709-9648-fe86ffa80534 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038765 Jan 15 15:50:37.542881 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 192/386] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 15:50:37 2022] POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 15:50:37.552232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5f152299-103f-4ddd-a9de-16c2ff534833 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:37.552851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5f152299-103f-4ddd-a9de-16c2ff534833 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:37.558873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f152299-103f-4ddd-a9de-16c2ff534833 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.560074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f152299-103f-4ddd-a9de-16c2ff534833 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.563120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f152299-103f-4ddd-a9de-16c2ff534833 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.563120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f152299-103f-4ddd-a9de-16c2ff534833 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.764756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5f152299-103f-4ddd-a9de-16c2ff534833 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action" status: 202 len: 0 microversion: 2.1 time: 0.215972 Jan 15 15:50:37.768659 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 195/387] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:37 2022] POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:37.774664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:37.774664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:37.781193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.781646 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.782442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:37.782917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:37.928666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:37.936869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-13fb42b3-f1d3-45cc-ac08-7359d11aebe1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1509 microversion: 2.1 time: 0.167092 Jan 15 15:50:37.937477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 193/388] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:38.008882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fc611b11-8349-4dcb-ad63-f26114d30f75 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:38.009421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e886039f-a3f3-47a5-8a9a-3386c0b2190a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:38.009820 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fc611b11-8349-4dcb-ad63-f26114d30f75 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:38.010277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e886039f-a3f3-47a5-8a9a-3386c0b2190a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:38.017353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e886039f-a3f3-47a5-8a9a-3386c0b2190a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.017982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc611b11-8349-4dcb-ad63-f26114d30f75 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.018117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e886039f-a3f3-47a5-8a9a-3386c0b2190a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.018454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc611b11-8349-4dcb-ad63-f26114d30f75 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.018816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e886039f-a3f3-47a5-8a9a-3386c0b2190a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.019400 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e886039f-a3f3-47a5-8a9a-3386c0b2190a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.022292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc611b11-8349-4dcb-ad63-f26114d30f75 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.022765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc611b11-8349-4dcb-ad63-f26114d30f75 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.141240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fc611b11-8349-4dcb-ad63-f26114d30f75 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.136369 Jan 15 15:50:38.142192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e886039f-a3f3-47a5-8a9a-3386c0b2190a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 14 microversion: 2.1 time: 0.136877 Jan 15 15:50:38.145979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 196/389] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:38 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:38.146110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 194/390] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:38 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 15:50:38.343299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:38.344003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:38.351538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.352032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:38.352294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.352857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:38.353254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.353834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.360272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.360710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.361479 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.362083 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.566641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:38.570331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:38.574758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2563195a-6531-4677-804b-135432194abf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.226401 Jan 15 15:50:38.575454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 195/391] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:38 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:38.579156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8579efbd-cda9-4380-bb7b-7195ef6f8653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.240071 Jan 15 15:50:38.581823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 197/392] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:38 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:38.633713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-bcc52b83-c368-4199-b21e-8208dfa7d367 req-410b127d-cda6-4b44-a777-af45994969e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b39b5-9a61-4502-9e45-1a4ad248e828", "name": "network-vif-plugged", "status": "completed", "tag": "907637c6-d745-48ee-88b6-2f0c86bbe725"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:38.635241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:38.635241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:50:38.643305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-bcc52b83-c368-4199-b21e-8208dfa7d367 req-410b127d-cda6-4b44-a777-af45994969e9 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.643744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-bcc52b83-c368-4199-b21e-8208dfa7d367 req-410b127d-cda6-4b44-a777-af45994969e9 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.656302 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-bcc52b83-c368-4199-b21e-8208dfa7d367 req-410b127d-cda6-4b44-a777-af45994969e9 service nova] Creating event network-vif-plugged:907637c6-d745-48ee-88b6-2f0c86bbe725 for instance 598b39b5-9a61-4502-9e45-1a4ad248e828 on hv-cinder-82481 Jan 15 15:50:38.661184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-bcc52b83-c368-4199-b21e-8208dfa7d367 req-410b127d-cda6-4b44-a777-af45994969e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031136 Jan 15 15:50:38.661816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 196/393] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:38.966071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:38.966468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:38.979504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.979965 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:38.983326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:38.983784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.147239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:39.158210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3f9d2f87-4730-437c-bbbb-f52c595aa8f7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:39.159219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3f9d2f87-4730-437c-bbbb-f52c595aa8f7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:39.171361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9d2f87-4730-437c-bbbb-f52c595aa8f7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.172788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0d2c0c6a-cf83-48e6-901d-984c5588848f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1509 microversion: 2.1 time: 0.214729 Jan 15 15:50:39.173563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 198/394] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:39.178068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3ca1f61e-0bd8-452a-8c52-06760cb47fed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:39.178985 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3ca1f61e-0bd8-452a-8c52-06760cb47fed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:39.181165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9d2f87-4730-437c-bbbb-f52c595aa8f7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.181986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9d2f87-4730-437c-bbbb-f52c595aa8f7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.182425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9d2f87-4730-437c-bbbb-f52c595aa8f7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.190429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ca1f61e-0bd8-452a-8c52-06760cb47fed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.190884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ca1f61e-0bd8-452a-8c52-06760cb47fed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.191681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ca1f61e-0bd8-452a-8c52-06760cb47fed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.192127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ca1f61e-0bd8-452a-8c52-06760cb47fed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.423020 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3ca1f61e-0bd8-452a-8c52-06760cb47fed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.248141 Jan 15 15:50:39.423759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 199/395] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:39 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:39.443440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3f9d2f87-4730-437c-bbbb-f52c595aa8f7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 8434 microversion: 2.1 time: 0.293739 Jan 15 15:50:39.444303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 197/396] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:39 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 8434 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:39.592250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:39.592912 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:39.598474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:39.599180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:39.599972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.600489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.601421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.601809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.608873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.609537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.610242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:39.610734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:39.806520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:39.814524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3d99517d-391a-4123-8c5f-bb931f403b8e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.219878 Jan 15 15:50:39.814738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:39.815295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 198/397] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:39 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:39.823130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-da2fb248-d011-4f25-9b3e-0ca927b3ad6c tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.235065 Jan 15 15:50:39.823859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 200/398] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:39 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:40.190269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:40.190885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:40.197314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.197828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.198706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.199144 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.331715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:40.339055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7889d019-b07a-40a2-8ee8-3def7be2164b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1509 microversion: 2.1 time: 0.152631 Jan 15 15:50:40.339614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 199/399] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:40.435747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-19d559d7-4b78-41c9-929b-4e825b4a0844 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:40.437721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-19d559d7-4b78-41c9-929b-4e825b4a0844 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:40.444796 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19d559d7-4b78-41c9-929b-4e825b4a0844 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.445176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19d559d7-4b78-41c9-929b-4e825b4a0844 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.446053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19d559d7-4b78-41c9-929b-4e825b4a0844 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.446497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19d559d7-4b78-41c9-929b-4e825b4a0844 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.455297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-af120cb5-5c71-4eb4-af59-4b1f0af7699b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:40.456303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-af120cb5-5c71-4eb4-af59-4b1f0af7699b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:40.462943 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-af120cb5-5c71-4eb4-af59-4b1f0af7699b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.463395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-af120cb5-5c71-4eb4-af59-4b1f0af7699b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.464379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-af120cb5-5c71-4eb4-af59-4b1f0af7699b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.464976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-af120cb5-5c71-4eb4-af59-4b1f0af7699b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.540354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-19d559d7-4b78-41c9-929b-4e825b4a0844 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.108950 Jan 15 15:50:40.541020 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 201/400] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:40 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:40.570051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-af120cb5-5c71-4eb4-af59-4b1f0af7699b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 15025 microversion: 2.1 time: 0.119545 Jan 15 15:50:40.570716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 200/401] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:40 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 15025 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:50:40.678681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-955a458d-2baf-473b-b835-fadc5aa0814a req-d34f1eff-454d-49ce-b292-303271bf190e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a1a9294-08f3-4060-8d7f-017bd388f212"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:40.678681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:40.678681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:50:40.686875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-955a458d-2baf-473b-b835-fadc5aa0814a req-d34f1eff-454d-49ce-b292-303271bf190e service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.687351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-955a458d-2baf-473b-b835-fadc5aa0814a req-d34f1eff-454d-49ce-b292-303271bf190e service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.707324 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-955a458d-2baf-473b-b835-fadc5aa0814a req-d34f1eff-454d-49ce-b292-303271bf190e service nova] Creating event network-vif-plugged:4a1a9294-08f3-4060-8d7f-017bd388f212 for instance 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 on hv-cinder-82481 Jan 15 15:50:40.707690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-955a458d-2baf-473b-b835-fadc5aa0814a req-d34f1eff-454d-49ce-b292-303271bf190e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035041 Jan 15 15:50:40.708048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 202/402] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:40.831820 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:40.832589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:40.842837 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:40.843544 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:40.844330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.844784 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.845572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.846016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.850702 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.851160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:40.851968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:40.852441 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:41.065678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:41.074307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:41.074414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-00b7c8a6-f70a-4a18-b677-a9bd475fb03a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.245770 Jan 15 15:50:41.075682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 201/403] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:40 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:41.079821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0447eda5-721b-4e0a-a787-49ffe1c148c1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1313 microversion: 2.1 time: 0.241973 Jan 15 15:50:41.080743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 203/404] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:40 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:41.357606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:41.358251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:41.364488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:41.365001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:41.365786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:41.366274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:41.552670 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d983d75-5b4f-49d6-af87-bc1d55d2a23a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:41.554288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d983d75-5b4f-49d6-af87-bc1d55d2a23a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:41.561289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d983d75-5b4f-49d6-af87-bc1d55d2a23a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:41.561743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d983d75-5b4f-49d6-af87-bc1d55d2a23a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:41.562549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d983d75-5b4f-49d6-af87-bc1d55d2a23a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:41.563177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d983d75-5b4f-49d6-af87-bc1d55d2a23a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:41.636272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d983d75-5b4f-49d6-af87-bc1d55d2a23a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.087350 Jan 15 15:50:41.637518 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 204/405] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:41 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:41.642291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e8156f1f-b782-4155-9b8c-80917f72c20a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:41.643299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e8156f1f-b782-4155-9b8c-80917f72c20a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:41.650319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8156f1f-b782-4155-9b8c-80917f72c20a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:41.650775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8156f1f-b782-4155-9b8c-80917f72c20a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:41.651572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8156f1f-b782-4155-9b8c-80917f72c20a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:41.652015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8156f1f-b782-4155-9b8c-80917f72c20a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:41.700918 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:41.708294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1be13137-bf77-44cd-bae6-3b584d224abd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1509 microversion: 2.1 time: 0.354937 Jan 15 15:50:41.708857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 202/406] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:41.766911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e8156f1f-b782-4155-9b8c-80917f72c20a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 17931 microversion: 2.1 time: 0.128482 Jan 15 15:50:41.767550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 205/407] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:41 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 17931 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:42.092941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:42.093561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:42.097828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:42.098471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:42.099662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.100114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.101361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.101361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.108579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.109041 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.109856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.110304 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.312048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:42.319765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d8da250c-c5a0-4e61-9e3a-9355cf73e6c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1319 microversion: 2.1 time: 0.231147 Jan 15 15:50:42.323437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 203/408] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:42 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:42.334521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:42.342033 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-57eab064-7e58-42ea-81f1-b931c32cabc1 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1496 microversion: 2.1 time: 0.248491 Jan 15 15:50:42.342590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 206/409] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:42 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1496 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:42.648313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e28cbd78-1d29-44b4-8af7-a28f0f3eb2d3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:42.649415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e28cbd78-1d29-44b4-8af7-a28f0f3eb2d3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:42.658329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e28cbd78-1d29-44b4-8af7-a28f0f3eb2d3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.658848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e28cbd78-1d29-44b4-8af7-a28f0f3eb2d3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.659863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e28cbd78-1d29-44b4-8af7-a28f0f3eb2d3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.660390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e28cbd78-1d29-44b4-8af7-a28f0f3eb2d3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.730309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:42.730930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:42.745675 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.746028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.746825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.747704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.758075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e28cbd78-1d29-44b4-8af7-a28f0f3eb2d3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.113235 Jan 15 15:50:42.758972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 204/410] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:42 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:42.784490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fdc4c106-e76d-4fb9-a842-29d0d67cd3de tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:42.785580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fdc4c106-e76d-4fb9-a842-29d0d67cd3de tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:42.793410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c106-e76d-4fb9-a842-29d0d67cd3de tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.794736 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c106-e76d-4fb9-a842-29d0d67cd3de tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.796085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c106-e76d-4fb9-a842-29d0d67cd3de tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:42.796556 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fdc4c106-e76d-4fb9-a842-29d0d67cd3de tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:42.884822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fdc4c106-e76d-4fb9-a842-29d0d67cd3de tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 18305 microversion: 2.1 time: 0.104173 Jan 15 15:50:42.888065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 205/411] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:42 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 18305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:42.907603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:42.914889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e41172c8-d546-4019-b968-597a7754ba7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1515 microversion: 2.1 time: 0.188417 Jan 15 15:50:42.915456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 207/412] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:43.337980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:43.338695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:43.346037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.346435 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.347320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.347892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.485782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:43.493789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-69a5552d-204d-485f-8c8e-a9c9f32cf458 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1508 microversion: 2.1 time: 0.159728 Jan 15 15:50:43.494360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 206/413] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:43 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:43.770065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-efa80798-be5d-475a-8a53-6d8e75a14aa3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:43.771160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-efa80798-be5d-475a-8a53-6d8e75a14aa3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:43.777325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-efa80798-be5d-475a-8a53-6d8e75a14aa3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.777852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-efa80798-be5d-475a-8a53-6d8e75a14aa3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.778763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-efa80798-be5d-475a-8a53-6d8e75a14aa3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.779162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-efa80798-be5d-475a-8a53-6d8e75a14aa3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.835647 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:43.836220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:43.842876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.843616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.844719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.845240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.847354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-efa80798-be5d-475a-8a53-6d8e75a14aa3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.081360 Jan 15 15:50:43.849779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 208/414] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:43 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:43.877963 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 15:50:43.896381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4c76bc6a-97ca-455d-898a-0e36dabf9c5d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:43.897720 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4c76bc6a-97ca-455d-898a-0e36dabf9c5d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:43.905691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c76bc6a-97ca-455d-898a-0e36dabf9c5d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.906148 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c76bc6a-97ca-455d-898a-0e36dabf9c5d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.907135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c76bc6a-97ca-455d-898a-0e36dabf9c5d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:43.908055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c76bc6a-97ca-455d-898a-0e36dabf9c5d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:43.996650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4c76bc6a-97ca-455d-898a-0e36dabf9c5d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 20909 microversion: 2.1 time: 0.104163 Jan 15 15:50:43.998311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 209/415] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:43 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 20909 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:50:44.242630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-aa5b924f-8681-4e6a-b027-00d22c470c89 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "DELETE /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 204 len: 0 microversion: 2.1 time: 0.410318 Jan 15 15:50:44.243219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 207/416] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 15:50:43 2022] DELETE /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 15:50:44.257300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:44.262865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:44.265141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:44.265591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:44.267004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:44.267752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:44.424868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:44.432283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a6506074-062b-4ea8-8a3a-eaa5fb2b1da3 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1502 microversion: 2.1 time: 0.178988 Jan 15 15:50:44.432950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 210/417] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:44 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:44.859733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-53290715-affe-46f6-a0ac-051dbca3865a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:44.860768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-53290715-affe-46f6-a0ac-051dbca3865a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:44.869088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53290715-affe-46f6-a0ac-051dbca3865a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:44.869088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53290715-affe-46f6-a0ac-051dbca3865a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:44.869088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53290715-affe-46f6-a0ac-051dbca3865a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:44.869088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53290715-affe-46f6-a0ac-051dbca3865a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:44.960251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-53290715-affe-46f6-a0ac-051dbca3865a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.104900 Jan 15 15:50:44.961400 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 208/418] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:44 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:45.008406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5d1372ce-fb59-4d93-a309-5ac5c7ee1934 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:45.009343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5d1372ce-fb59-4d93-a309-5ac5c7ee1934 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:45.016554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1372ce-fb59-4d93-a309-5ac5c7ee1934 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.016979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1372ce-fb59-4d93-a309-5ac5c7ee1934 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:45.018017 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1372ce-fb59-4d93-a309-5ac5c7ee1934 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.018446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1372ce-fb59-4d93-a309-5ac5c7ee1934 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:45.140728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5d1372ce-fb59-4d93-a309-5ac5c7ee1934 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 22548 microversion: 2.1 time: 0.135767 Jan 15 15:50:45.141558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 211/419] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:45 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 22548 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:45.451984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:45.452712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:45.459664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.460107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:45.460916 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.461347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:45.600350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:45.607756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-98662dc2-a0de-4a81-8ab6-172402adeb20 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1502 microversion: 2.1 time: 0.161592 Jan 15 15:50:45.608338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 209/420] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:45 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:45.879120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:45.879866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:45.886641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.887089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:45.888544 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.889383 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:45.973030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-545f01cc-9814-4f1b-9ffc-d1f62cd27035 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:45.974024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-545f01cc-9814-4f1b-9ffc-d1f62cd27035 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:45.980612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-545f01cc-9814-4f1b-9ffc-d1f62cd27035 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.981067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-545f01cc-9814-4f1b-9ffc-d1f62cd27035 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:45.982058 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-545f01cc-9814-4f1b-9ffc-d1f62cd27035 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:45.982526 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-545f01cc-9814-4f1b-9ffc-d1f62cd27035 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:46.027179 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:46.034742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9b36c88c-544a-45e1-aa08-b374f41c5fbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1515 microversion: 2.1 time: 0.159674 Jan 15 15:50:46.037532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 212/421] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:46.050775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-33bbb30a-cdbb-4735-b4c6-61ec6969f3ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dc95756-bdc1-4049-b6ea-f95b127dca76"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:46.051874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-33bbb30a-cdbb-4735-b4c6-61ec6969f3ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:46.052560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-545f01cc-9814-4f1b-9ffc-d1f62cd27035 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.083233 Jan 15 15:50:46.056507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 210/422] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:45 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:46.057949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33bbb30a-cdbb-4735-b4c6-61ec6969f3ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:46.058443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33bbb30a-cdbb-4735-b4c6-61ec6969f3ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:46.059240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33bbb30a-cdbb-4735-b4c6-61ec6969f3ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:46.060208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-33bbb30a-cdbb-4735-b4c6-61ec6969f3ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:46.153681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c3d50567-a0b5-40b2-ade3-b31ee2de88a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:46.154948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c3d50567-a0b5-40b2-ade3-b31ee2de88a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:46.170951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3d50567-a0b5-40b2-ade3-b31ee2de88a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:46.171488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3d50567-a0b5-40b2-ade3-b31ee2de88a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:46.172341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3d50567-a0b5-40b2-ade3-b31ee2de88a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:46.172799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3d50567-a0b5-40b2-ade3-b31ee2de88a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:46.270898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c3d50567-a0b5-40b2-ade3-b31ee2de88a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 23227 microversion: 2.1 time: 0.121656 Jan 15 15:50:46.271547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 211/423] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:46 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 23227 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:50:46.625814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:46.626436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:46.634046 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:46.634547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:46.635341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:46.635782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:46.790161 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:46.798684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c24ac14c-4c43-484b-b1ba-68ad19e1f5da tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1502 microversion: 2.1 time: 0.177735 Jan 15 15:50:46.799253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 212/424] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:46 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:46.839599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-33bbb30a-cdbb-4735-b4c6-61ec6969f3ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792329 Jan 15 15:50:46.840359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 213/425] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 15:50:46 2022] POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:50:47.064372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-224c0418-974e-4761-93c5-fe65931f4006 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:47.065946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-224c0418-974e-4761-93c5-fe65931f4006 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:47.072509 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-224c0418-974e-4761-93c5-fe65931f4006 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.072966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-224c0418-974e-4761-93c5-fe65931f4006 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.073764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-224c0418-974e-4761-93c5-fe65931f4006 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.074205 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-224c0418-974e-4761-93c5-fe65931f4006 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.142473 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-224c0418-974e-4761-93c5-fe65931f4006 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.081741 Jan 15 15:50:47.143135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 213/426] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:47 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:50:47.283661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7db510d0-3337-4b23-905f-040fb2214919 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:47.284769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7db510d0-3337-4b23-905f-040fb2214919 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:47.291125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7db510d0-3337-4b23-905f-040fb2214919 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.291514 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7db510d0-3337-4b23-905f-040fb2214919 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.292330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7db510d0-3337-4b23-905f-040fb2214919 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.292774 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7db510d0-3337-4b23-905f-040fb2214919 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.331676 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-03fb5962-f987-4fab-b4c3-57b48439ab58 req-eef977f9-34ed-451c-b695-afbdf7534b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b39b5-9a61-4502-9e45-1a4ad248e828", "name": "network-vif-deleted", "tag": "907637c6-d745-48ee-88b6-2f0c86bbe725"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:47.333233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:47.333233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:50:47.342414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-03fb5962-f987-4fab-b4c3-57b48439ab58 req-eef977f9-34ed-451c-b695-afbdf7534b37 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.343090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-03fb5962-f987-4fab-b4c3-57b48439ab58 req-eef977f9-34ed-451c-b695-afbdf7534b37 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.356064 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-03fb5962-f987-4fab-b4c3-57b48439ab58 req-eef977f9-34ed-451c-b695-afbdf7534b37 service nova] Creating event network-vif-deleted:907637c6-d745-48ee-88b6-2f0c86bbe725 for instance 598b39b5-9a61-4502-9e45-1a4ad248e828 on hv-cinder-82481 Jan 15 15:50:47.361620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-03fb5962-f987-4fab-b4c3-57b48439ab58 req-eef977f9-34ed-451c-b695-afbdf7534b37 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041482 Jan 15 15:50:47.362212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 214/427] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:47.377399 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7db510d0-3337-4b23-905f-040fb2214919 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 23796 microversion: 2.1 time: 0.098395 Jan 15 15:50:47.378428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 214/428] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:47 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 23796 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:47.527611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-16430431", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:47.583996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] validate_networks() for None {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:50:47.815641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:47.816788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:47.824394 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.824846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.827934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.827934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.860127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.860685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.861143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.objects.instance [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lazy-loading 'fault' on Instance uuid 598b39b5-9a61-4502-9e45-1a4ad248e828 {{(pid=123221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:50:47.886855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:50:47.887335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:50:47.888365 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:50:47.888774 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:50:47.889182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:50:47.901831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.902283 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.903257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:47.904783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:47.913888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6cb0d17d33488e8f8ac79b9a764d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7848167bcae046ed80e861268575fcb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:47.924370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Getting quotas for project 8c6d63abfeb44464b22e36625f62cf0a. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:50:47.925309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d365336f-843d-42aa-9537-8d918b64e676 tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 200 len: 1303 microversion: 2.1 time: 0.113928 Jan 15 15:50:47.932734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Getting quotas for user 90588c799023425e9d12db7c2199fae4 and project 8c6d63abfeb44464b22e36625f62cf0a. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:50:47.936035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 215/429] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:47 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:50:47.944718 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:50:47.947293 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:50:48.054932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5f877df0-1a43-4de4-9c5d-5a698119a300 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534787 Jan 15 15:50:48.055725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 215/430] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:50:48.066069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aa677c32-4d81-4838-b8ca-add1325bf43f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:48.067380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aa677c32-4d81-4838-b8ca-add1325bf43f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:48.126249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-aa677c32-4d81-4838-b8ca-add1325bf43f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:48.133772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aa677c32-4d81-4838-b8ca-add1325bf43f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1213 microversion: 2.1 time: 0.071614 Jan 15 15:50:48.134341 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 216/431] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:48 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:48.155115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d000e9d1-bc3d-4686-814e-b3285849165d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:48.156561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d000e9d1-bc3d-4686-814e-b3285849165d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:48.162691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d000e9d1-bc3d-4686-814e-b3285849165d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:48.163143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d000e9d1-bc3d-4686-814e-b3285849165d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:48.164045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d000e9d1-bc3d-4686-814e-b3285849165d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:48.164842 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d000e9d1-bc3d-4686-814e-b3285849165d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:48.236844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d000e9d1-bc3d-4686-814e-b3285849165d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.085773 Jan 15 15:50:48.237486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 216/432] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:48 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:48.388931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-54f1d98e-50f7-4979-9b41-7a94e65fe34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:48.389867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-54f1d98e-50f7-4979-9b41-7a94e65fe34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:48.397579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54f1d98e-50f7-4979-9b41-7a94e65fe34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:48.398034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54f1d98e-50f7-4979-9b41-7a94e65fe34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:48.398833 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54f1d98e-50f7-4979-9b41-7a94e65fe34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:48.399278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54f1d98e-50f7-4979-9b41-7a94e65fe34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:48.502265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-54f1d98e-50f7-4979-9b41-7a94e65fe34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 25041 microversion: 2.1 time: 0.116803 Jan 15 15:50:48.503972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 217/433] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:48 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 25041 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:48.943160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:48.943892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] [instance: 598b39b5-9a61-4502-9e45-1a4ad248e828] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:48.952829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:48.953279 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:48.954146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:48.954554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:48.969591 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] HTTP exception thrown: Instance 598b39b5-9a61-4502-9e45-1a4ad248e828 could not be found. Jan 15 15:50:48.970185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] Returning 404 to user: Instance 598b39b5-9a61-4502-9e45-1a4ad248e828 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:50:48.971009 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-56d46c94-ce5e-4a84-abe9-2dfc060f80cf tempest-VolumesActionsTest-372062278 tempest-VolumesActionsTest-372062278-project] 10.222.0.36 "GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828" status: 404 len: 111 microversion: 2.1 time: 0.032115 Jan 15 15:50:48.971563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 217/434] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:48 2022] GET /compute/v2.1/servers/598b39b5-9a61-4502-9e45-1a4ad248e828 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:50:49.151072 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:49.151762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:49.159523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:49.159993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:49.160801 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:49.161236 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:49.221740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:49.231274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f1b59383-86a1-4dea-a780-30c96ab3d123 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1217 microversion: 2.1 time: 0.084106 Jan 15 15:50:49.239251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 218/435] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:49 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:49.249211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c17c6271-0ba5-43f9-a5c3-6a610051e07e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:49.250234 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c17c6271-0ba5-43f9-a5c3-6a610051e07e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:49.256432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c17c6271-0ba5-43f9-a5c3-6a610051e07e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:49.256878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c17c6271-0ba5-43f9-a5c3-6a610051e07e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:49.257647 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c17c6271-0ba5-43f9-a5c3-6a610051e07e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:49.258081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c17c6271-0ba5-43f9-a5c3-6a610051e07e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:49.363648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c17c6271-0ba5-43f9-a5c3-6a610051e07e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.118539 Jan 15 15:50:49.364766 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 218/436] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:49 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:49.515134 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-72daac28-683a-4081-ae81-6dce4789b556 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:49.516050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-72daac28-683a-4081-ae81-6dce4789b556 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:49.522649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72daac28-683a-4081-ae81-6dce4789b556 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:49.523100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72daac28-683a-4081-ae81-6dce4789b556 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:49.526365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72daac28-683a-4081-ae81-6dce4789b556 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:49.526365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72daac28-683a-4081-ae81-6dce4789b556 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:49.612124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-72daac28-683a-4081-ae81-6dce4789b556 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 26133 microversion: 2.1 time: 0.101080 Jan 15 15:50:49.613378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 219/437] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:49 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 26133 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:50.254542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:50.255402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:50.264312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:50.264769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:50.265571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:50.266031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:50.336546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:50.348111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-52598160-a151-4c82-8209-d3cc74ffacdd tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1265 microversion: 2.1 time: 0.097493 Jan 15 15:50:50.348832 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 219/438] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:50 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:50.377826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c08ad69f-55be-471d-be81-1bd327340742 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:50.379406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c08ad69f-55be-471d-be81-1bd327340742 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:50.386467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c08ad69f-55be-471d-be81-1bd327340742 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:50.386980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c08ad69f-55be-471d-be81-1bd327340742 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:50.388313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c08ad69f-55be-471d-be81-1bd327340742 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:50.388869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c08ad69f-55be-471d-be81-1bd327340742 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:50.503501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c08ad69f-55be-471d-be81-1bd327340742 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.129888 Jan 15 15:50:50.504679 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 220/439] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:50 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:50.624491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c07b6f66-db87-4c69-94c2-23cc897097a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:50.625640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c07b6f66-db87-4c69-94c2-23cc897097a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:50.632231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c07b6f66-db87-4c69-94c2-23cc897097a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:50.632695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c07b6f66-db87-4c69-94c2-23cc897097a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:50.633502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c07b6f66-db87-4c69-94c2-23cc897097a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:50.633942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c07b6f66-db87-4c69-94c2-23cc897097a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:50.754782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c07b6f66-db87-4c69-94c2-23cc897097a5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 26935 microversion: 2.1 time: 0.134181 Jan 15 15:50:50.759080 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 220/440] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:50 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 26935 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:51.368177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:51.369719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:51.377771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:51.378232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:51.379035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:51.379482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:51.445810 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:51.453772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c45f2b76-d115-4f20-88e9-e3ea08ad2a09 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1271 microversion: 2.1 time: 0.089731 Jan 15 15:50:51.454333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 221/441] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:51 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:50:51.517463 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cbe021ea-6506-4b42-b459-1dba0636e786 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:51.519736 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cbe021ea-6506-4b42-b459-1dba0636e786 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:51.550165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe021ea-6506-4b42-b459-1dba0636e786 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:51.552287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe021ea-6506-4b42-b459-1dba0636e786 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:51.553159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe021ea-6506-4b42-b459-1dba0636e786 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:51.555831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe021ea-6506-4b42-b459-1dba0636e786 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:51.767987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7d5a8073-beea-4444-9750-100bff6b13e8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:51.774111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7d5a8073-beea-4444-9750-100bff6b13e8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:51.781293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d5a8073-beea-4444-9750-100bff6b13e8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:51.781848 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d5a8073-beea-4444-9750-100bff6b13e8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:51.782640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d5a8073-beea-4444-9750-100bff6b13e8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:51.783077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d5a8073-beea-4444-9750-100bff6b13e8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:59.098419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cbe021ea-6506-4b42-b459-1dba0636e786 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 7.586714 Jan 15 15:50:59.100705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 221/442] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:50:51 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 7590 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:50:59.110253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:50:59.111010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:50:59.117364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:59.122441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:59.122441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:59.122441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:59.180822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7d5a8073-beea-4444-9750-100bff6b13e8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 27738 microversion: 2.1 time: 7.416297 Jan 15 15:50:59.181388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 222/443] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:50:51 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 27738 bytes in 7419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:50:59.186792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-519da310-ddbe-41a6-bdd3-f075d74c0350 req-4519033b-84c1-4269-b3fa-fd5cc3c87f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245e1081-244c-45d8-80f0-7a89d4b3849c", "tag": "dfe88715-11d9-4c79-9db5-a7376525ed52"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:50:59.189764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:50:59.189764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:50:59.198517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-519da310-ddbe-41a6-bdd3-f075d74c0350 req-4519033b-84c1-4269-b3fa-fd5cc3c87f4b service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:50:59.198960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-519da310-ddbe-41a6-bdd3-f075d74c0350 req-4519033b-84c1-4269-b3fa-fd5cc3c87f4b service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:50:59.210149 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-519da310-ddbe-41a6-bdd3-f075d74c0350 req-4519033b-84c1-4269-b3fa-fd5cc3c87f4b service nova] Creating event network-changed:dfe88715-11d9-4c79-9db5-a7376525ed52 for instance 245e1081-244c-45d8-80f0-7a89d4b3849c on hv-cinder-82481 Jan 15 15:50:59.214847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-519da310-ddbe-41a6-bdd3-f075d74c0350 req-4519033b-84c1-4269-b3fa-fd5cc3c87f4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032168 Jan 15 15:50:59.215508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 223/444] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:50:59.260474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:50:59.267612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e25ca3dc-ce6e-4a30-8aef-72aa20a4be79 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.165093 Jan 15 15:50:59.268248 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 222/445] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:50:59 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:00.111987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-042d564e-0c55-4051-82e2-be3af372750a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:00.113003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-042d564e-0c55-4051-82e2-be3af372750a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:00.119402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-042d564e-0c55-4051-82e2-be3af372750a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:00.119962 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-042d564e-0c55-4051-82e2-be3af372750a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:00.120793 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-042d564e-0c55-4051-82e2-be3af372750a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:00.121247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-042d564e-0c55-4051-82e2-be3af372750a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:00.193356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2e14026a-3a34-4273-9767-357ae2074898 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:00.194300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2e14026a-3a34-4273-9767-357ae2074898 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:00.200503 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e14026a-3a34-4273-9767-357ae2074898 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:00.200978 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e14026a-3a34-4273-9767-357ae2074898 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:00.201754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e14026a-3a34-4273-9767-357ae2074898 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:00.202186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e14026a-3a34-4273-9767-357ae2074898 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:00.397405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2e14026a-3a34-4273-9767-357ae2074898 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 27804 microversion: 2.1 time: 0.207515 Jan 15 15:51:00.401230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 223/446] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:00 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 27804 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:00.402863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:00.403555 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:00.410934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:00.411517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:00.412341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:00.412804 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:00.425454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-042d564e-0c55-4051-82e2-be3af372750a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.317889 Jan 15 15:51:00.429465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 224/447] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:00 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:00.552822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:00.561630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3020bc4f-04f1-41b8-88ff-628942c042ae tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.162416 Jan 15 15:51:00.562179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 224/448] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:00 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:01.409654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0595aaaf-956d-46de-9162-40f78c1466b4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:01.410694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0595aaaf-956d-46de-9162-40f78c1466b4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:01.417781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0595aaaf-956d-46de-9162-40f78c1466b4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:01.418236 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0595aaaf-956d-46de-9162-40f78c1466b4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:01.419027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0595aaaf-956d-46de-9162-40f78c1466b4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:01.419727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0595aaaf-956d-46de-9162-40f78c1466b4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:01.438422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ebe1ae89-1fbc-4d9d-b3d8-cfcf32ddcd1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:01.440750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ebe1ae89-1fbc-4d9d-b3d8-cfcf32ddcd1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:01.448205 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1ae89-1fbc-4d9d-b3d8-cfcf32ddcd1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:01.448923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1ae89-1fbc-4d9d-b3d8-cfcf32ddcd1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:01.449933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1ae89-1fbc-4d9d-b3d8-cfcf32ddcd1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:01.450554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe1ae89-1fbc-4d9d-b3d8-cfcf32ddcd1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:01.611723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ebe1ae89-1fbc-4d9d-b3d8-cfcf32ddcd1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.177369 Jan 15 15:51:01.613189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 225/449] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:01 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:01.619196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:01.620076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:01.627692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:01.628433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:01.629414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:01.630008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:01.639719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0595aaaf-956d-46de-9162-40f78c1466b4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 27804 microversion: 2.1 time: 0.226834 Jan 15 15:51:01.641230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 225/450] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:01 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 27804 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:01.781245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:01.794025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-997dc1ad-0b5b-42c8-b46a-b4c8fc1b6e97 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.179507 Jan 15 15:51:01.794858 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 226/451] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:01 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:02.625664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9eac2582-8b61-4c07-a367-4dc3c29833d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:02.627214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9eac2582-8b61-4c07-a367-4dc3c29833d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:02.634182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eac2582-8b61-4c07-a367-4dc3c29833d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.639633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eac2582-8b61-4c07-a367-4dc3c29833d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.639633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eac2582-8b61-4c07-a367-4dc3c29833d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.639633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eac2582-8b61-4c07-a367-4dc3c29833d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.652656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-958325d6-850b-49a5-84d2-327b957a82fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:02.655598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-958325d6-850b-49a5-84d2-327b957a82fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:02.670409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-958325d6-850b-49a5-84d2-327b957a82fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.671871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-958325d6-850b-49a5-84d2-327b957a82fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.672813 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-958325d6-850b-49a5-84d2-327b957a82fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.673914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-958325d6-850b-49a5-84d2-327b957a82fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.786445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9eac2582-8b61-4c07-a367-4dc3c29833d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.165132 Jan 15 15:51:02.791676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 226/452] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:02 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:02.809395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-958325d6-850b-49a5-84d2-327b957a82fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 27930 microversion: 2.1 time: 0.161011 Jan 15 15:51:02.820810 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:02.825069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 227/453] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:02 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 27930 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:02.825811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:02.831012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:02.832079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:02.839141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.839585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.840603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.841200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.847693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.848776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.850271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:02.850819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:02.869900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lazy-loading 'flavor' on Instance uuid ba9275a1-4d53-4571-be72-2b4524364e4a {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:51:03.054980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:03.063182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e8ea67fb-8220-4e4a-ac29-71efad31a6cb tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.253508 Jan 15 15:51:03.065908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 227/454] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:02 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:03.230120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dc333b0b-43ec-4123-af8f-c3ecd65bda85 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action" status: 200 len: 32 microversion: 2.1 time: 0.403129 Jan 15 15:51:03.230721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 228/455] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:02 2022] POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:51:03.240896 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:03.241596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:03.250553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:03.251177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:03.252282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:03.252726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:03.453917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:03.463377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b10f6466-9380-4600-b69d-3b745f81223b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.226228 Jan 15 15:51:03.471762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 228/456] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:03.800708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-60da3d94-f36a-4f69-abb1-d412c0210b7a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:03.801715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-60da3d94-f36a-4f69-abb1-d412c0210b7a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:03.809012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60da3d94-f36a-4f69-abb1-d412c0210b7a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:03.809493 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60da3d94-f36a-4f69-abb1-d412c0210b7a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:03.810280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60da3d94-f36a-4f69-abb1-d412c0210b7a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:03.810709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60da3d94-f36a-4f69-abb1-d412c0210b7a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:03.824309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-57be7bd8-20dc-45b4-8d62-b4620e53d366 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:03.826534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-57be7bd8-20dc-45b4-8d62-b4620e53d366 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:03.834699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57be7bd8-20dc-45b4-8d62-b4620e53d366 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:03.835459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57be7bd8-20dc-45b4-8d62-b4620e53d366 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:03.836507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57be7bd8-20dc-45b4-8d62-b4620e53d366 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:03.837646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57be7bd8-20dc-45b4-8d62-b4620e53d366 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:03.933102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-60da3d94-f36a-4f69-abb1-d412c0210b7a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.137622 Jan 15 15:51:03.933754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 229/457] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:03 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:04.001074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-57be7bd8-20dc-45b4-8d62-b4620e53d366 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28048 microversion: 2.1 time: 0.183263 Jan 15 15:51:04.001834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 229/458] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:03 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28048 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:04.081983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:04.084266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:04.090217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:04.090934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:04.091936 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:04.092613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:04.263449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:04.273710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-72b8a636-bbb1-47cf-a762-e75b9e6ce69a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.195604 Jan 15 15:51:04.285333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 230/459] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:04 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:04.481972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:04.482681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:04.494981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:04.496774 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:04.498091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:04.498684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:04.715944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:04.726190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7f74c133-e3e3-4525-a3ef-624824f2cfb9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.248308 Jan 15 15:51:04.727087 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 230/460] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:04.951289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7b0e5942-0d1f-45c3-9511-32a089dfea24 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:04.952237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7b0e5942-0d1f-45c3-9511-32a089dfea24 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:04.959268 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b0e5942-0d1f-45c3-9511-32a089dfea24 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:04.959758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b0e5942-0d1f-45c3-9511-32a089dfea24 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:04.960580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b0e5942-0d1f-45c3-9511-32a089dfea24 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:04.961021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b0e5942-0d1f-45c3-9511-32a089dfea24 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:05.022942 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-496f3dd6-7d75-4e7b-9f48-42e320a82a4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:05.024567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-496f3dd6-7d75-4e7b-9f48-42e320a82a4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:05.031868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-496f3dd6-7d75-4e7b-9f48-42e320a82a4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:05.032374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-496f3dd6-7d75-4e7b-9f48-42e320a82a4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:05.034195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-496f3dd6-7d75-4e7b-9f48-42e320a82a4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:05.034641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-496f3dd6-7d75-4e7b-9f48-42e320a82a4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:05.049995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7b0e5942-0d1f-45c3-9511-32a089dfea24 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.107277 Jan 15 15:51:05.050658 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 231/461] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:04 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:05.120156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-496f3dd6-7d75-4e7b-9f48-42e320a82a4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28123 microversion: 2.1 time: 0.100725 Jan 15 15:51:05.120823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 231/462] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:05 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28123 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:05.300726 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:05.302106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:05.309554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:05.310337 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:05.311411 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:05.312022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:05.572562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:05.584726 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e5860be7-a287-4aa5-b330-2359f267da52 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.289977 Jan 15 15:51:05.594537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 232/463] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:05 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:05.747206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:05.748864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:05.760116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:05.761591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:05.763132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:05.763673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:05.983713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:05.994408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-504af6a6-0bed-4954-b1d3-f4d84c4f6005 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.251426 Jan 15 15:51:06.005835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 232/464] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:06.061238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2f1a916b-4349-473f-856c-de2b0bf5c18c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:06.062230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2f1a916b-4349-473f-856c-de2b0bf5c18c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:06.068884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f1a916b-4349-473f-856c-de2b0bf5c18c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:06.069335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f1a916b-4349-473f-856c-de2b0bf5c18c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:06.070320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f1a916b-4349-473f-856c-de2b0bf5c18c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:06.070766 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f1a916b-4349-473f-856c-de2b0bf5c18c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:06.133876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6f41ae7f-e695-47c4-94d5-d20ba6a07ce5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:06.135175 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6f41ae7f-e695-47c4-94d5-d20ba6a07ce5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:06.143180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6f41ae7f-e695-47c4-94d5-d20ba6a07ce5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:06.147009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6f41ae7f-e695-47c4-94d5-d20ba6a07ce5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:06.147857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6f41ae7f-e695-47c4-94d5-d20ba6a07ce5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:06.148358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6f41ae7f-e695-47c4-94d5-d20ba6a07ce5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:06.157359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2f1a916b-4349-473f-856c-de2b0bf5c18c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.099587 Jan 15 15:51:06.159216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 233/465] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:06 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:06.323974 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6f41ae7f-e695-47c4-94d5-d20ba6a07ce5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.191312 Jan 15 15:51:06.323974 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 233/466] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:06 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:06.602888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:06.603590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:06.610909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:06.611369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:06.612160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:06.612614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:06.807595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:06.817492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2d459bb0-812a-4a8f-b366-04828303b851 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.217618 Jan 15 15:51:06.825598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 234/467] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:06 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:07.014321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:07.015495 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:07.041276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:07.043323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:07.044911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:07.045775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:07.170123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8915f8ee-62d8-474c-8bfb-5a2d46ae4f80 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:07.171232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8915f8ee-62d8-474c-8bfb-5a2d46ae4f80 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:07.179560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8915f8ee-62d8-474c-8bfb-5a2d46ae4f80 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:07.180010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8915f8ee-62d8-474c-8bfb-5a2d46ae4f80 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:07.180828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8915f8ee-62d8-474c-8bfb-5a2d46ae4f80 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:07.181697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8915f8ee-62d8-474c-8bfb-5a2d46ae4f80 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:07.289632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:07.303162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-038c93df-fdd0-4fef-ba41-fb6026bd3295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.293892 Jan 15 15:51:07.304308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 234/468] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:07.338773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2472a79d-4c29-48b4-a1d7-9ebdde3ce7c7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:07.343195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2472a79d-4c29-48b4-a1d7-9ebdde3ce7c7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:07.352693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2472a79d-4c29-48b4-a1d7-9ebdde3ce7c7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:07.352693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2472a79d-4c29-48b4-a1d7-9ebdde3ce7c7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:07.352693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2472a79d-4c29-48b4-a1d7-9ebdde3ce7c7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:07.353355 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2472a79d-4c29-48b4-a1d7-9ebdde3ce7c7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:12.972098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8915f8ee-62d8-474c-8bfb-5a2d46ae4f80 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 5.805959 Jan 15 15:51:12.973105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 235/469] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:07 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 5808 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:12.976676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2472a79d-4c29-48b4-a1d7-9ebdde3ce7c7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 5.645838 Jan 15 15:51:12.980475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 235/470] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:07 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 5647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:12.980623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:12.980623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:12.982203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:12.982888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:12.986559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:12.987015 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:12.987801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:12.988258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:12.991957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:12.992444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:12.993234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:12.993670 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:13.215262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:13.218831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:13.230865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e188a2e5-938b-43be-9e42-2c0e716ffee8 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.256446 Jan 15 15:51:13.231378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 236/471] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:12 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:13.233772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9b10cc6e-2beb-4698-9d0b-7f0fbd8c6ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.255170 Jan 15 15:51:13.234346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 236/472] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:13.247468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-3e12a9ae-f4f6-4d1c-88ac-44873503ded8 req-3d9dd429-8336-4765-85cd-2a516057bf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245e1081-244c-45d8-80f0-7a89d4b3849c", "name": "network-vif-plugged", "status": "completed", "tag": "dfe88715-11d9-4c79-9db5-a7376525ed52"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:13.249147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:51:13.249147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:51:13.256977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-3e12a9ae-f4f6-4d1c-88ac-44873503ded8 req-3d9dd429-8336-4765-85cd-2a516057bf4f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:13.257428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-3e12a9ae-f4f6-4d1c-88ac-44873503ded8 req-3d9dd429-8336-4765-85cd-2a516057bf4f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:13.273575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-3e12a9ae-f4f6-4d1c-88ac-44873503ded8 req-3d9dd429-8336-4765-85cd-2a516057bf4f service nova] Creating event network-vif-plugged:dfe88715-11d9-4c79-9db5-a7376525ed52 for instance 245e1081-244c-45d8-80f0-7a89d4b3849c on hv-cinder-82481 Jan 15 15:51:13.286626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-3e12a9ae-f4f6-4d1c-88ac-44873503ded8 req-3d9dd429-8336-4765-85cd-2a516057bf4f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053809 Jan 15 15:51:13.287553 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 237/473] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:51:13.983453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bd21af6c-ccf7-47c4-99c7-ba7dfbb041ce tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:13.987295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bd21af6c-ccf7-47c4-99c7-ba7dfbb041ce tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:13.991867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c0785452-a34f-497a-9ac2-05fa234b5ff1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:13.994458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c0785452-a34f-497a-9ac2-05fa234b5ff1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:13.994693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd21af6c-ccf7-47c4-99c7-ba7dfbb041ce tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:13.995014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd21af6c-ccf7-47c4-99c7-ba7dfbb041ce tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:13.995818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd21af6c-ccf7-47c4-99c7-ba7dfbb041ce tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:13.996327 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd21af6c-ccf7-47c4-99c7-ba7dfbb041ce tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:14.004293 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0785452-a34f-497a-9ac2-05fa234b5ff1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:14.004996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0785452-a34f-497a-9ac2-05fa234b5ff1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:14.005960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0785452-a34f-497a-9ac2-05fa234b5ff1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:14.006558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0785452-a34f-497a-9ac2-05fa234b5ff1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:14.536695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bd21af6c-ccf7-47c4-99c7-ba7dfbb041ce tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.556596 Jan 15 15:51:14.537463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 237/474] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:13 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:14.543440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:14.549299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:14.558772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:14.559455 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:14.560498 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:14.561158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:14.565672 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c0785452-a34f-497a-9ac2-05fa234b5ff1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.580755 Jan 15 15:51:14.571010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 238/475] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:13 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:14.577450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:14.578414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:14.594266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:14.597572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:14.600329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:14.601432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:14.750976 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:14.758987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ce611de8-fe90-43ea-8765-9c24e805f34d tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.220123 Jan 15 15:51:14.767576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 238/476] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:14 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:14.823610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:14.834932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e36541c4-f51e-4b7c-afa3-5a9e667b1517 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.261678 Jan 15 15:51:14.835600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 239/477] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:15.549975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ea321333-9fde-45c8-990a-51472c5359ed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:15.552076 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ea321333-9fde-45c8-990a-51472c5359ed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:15.559333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea321333-9fde-45c8-990a-51472c5359ed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.559988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea321333-9fde-45c8-990a-51472c5359ed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:15.561048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea321333-9fde-45c8-990a-51472c5359ed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.561509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea321333-9fde-45c8-990a-51472c5359ed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:15.578406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0bb09ccb-468b-45f7-9230-cdfe9af8cb23 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:15.579270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0bb09ccb-468b-45f7-9230-cdfe9af8cb23 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:15.585712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bb09ccb-468b-45f7-9230-cdfe9af8cb23 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.586398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bb09ccb-468b-45f7-9230-cdfe9af8cb23 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:15.587352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bb09ccb-468b-45f7-9230-cdfe9af8cb23 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.587952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bb09ccb-468b-45f7-9230-cdfe9af8cb23 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:15.788869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ea321333-9fde-45c8-990a-51472c5359ed tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.242770 Jan 15 15:51:15.790445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 239/478] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:15 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:15.800632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:15.801782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:15.802999 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0bb09ccb-468b-45f7-9230-cdfe9af8cb23 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.228240 Jan 15 15:51:15.804295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 240/479] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:15 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:15.818383 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.820194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:15.821821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.823008 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:15.852383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:15.853464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:15.865231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.865995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:15.867020 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:15.867650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:16.130254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:16.138833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:16.140705 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f1f2e215-c6d5-456d-be8e-cced18a41bc9 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1313 microversion: 2.1 time: 0.348873 Jan 15 15:51:16.152485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 240/480] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:15 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:16.161388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e686324f-16ba-4851-a80d-a850db0a5e30 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.312900 Jan 15 15:51:16.162290 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 241/481] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:16.804727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d4a5a5da-bc08-4169-b116-90203a5cd88a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:16.806509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d4a5a5da-bc08-4169-b116-90203a5cd88a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:16.816289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4a5a5da-bc08-4169-b116-90203a5cd88a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:16.817109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4a5a5da-bc08-4169-b116-90203a5cd88a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:16.818343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4a5a5da-bc08-4169-b116-90203a5cd88a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:16.819190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4a5a5da-bc08-4169-b116-90203a5cd88a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:16.823552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-64ad27a4-64c0-4630-ba4a-bea0a402d1c4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:16.826730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-64ad27a4-64c0-4630-ba4a-bea0a402d1c4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:16.852057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64ad27a4-64c0-4630-ba4a-bea0a402d1c4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:16.853217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64ad27a4-64c0-4630-ba4a-bea0a402d1c4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:16.857841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64ad27a4-64c0-4630-ba4a-bea0a402d1c4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:16.858947 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64ad27a4-64c0-4630-ba4a-bea0a402d1c4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:16.919108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d4a5a5da-bc08-4169-b116-90203a5cd88a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.120845 Jan 15 15:51:16.922443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 241/482] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:16 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:16.967365 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-64ad27a4-64c0-4630-ba4a-bea0a402d1c4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.153457 Jan 15 15:51:16.971869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 242/483] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:16 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:17.158142 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:17.159161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:17.166610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.167195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.168222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.168697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.180491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:17.181586 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:17.190085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.190907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.191960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.192669 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.388798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:17.402107 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ceb77e1a-1f2a-448b-839a-f34ec652183a tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1463 microversion: 2.1 time: 0.248660 Jan 15 15:51:17.402728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 242/484] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:17 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:17.459349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:17.459889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:17.471537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.472014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.472882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.473339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.480792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:17.498216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ad8eb4f4-2f6d-4249-891f-8cb03d4eacbb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.322366 Jan 15 15:51:17.499125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 243/485] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:17.512986 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 15:51:17.864650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bfe354de-9098-4801-b459-68b36afc5573 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "DELETE /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 204 len: 0 microversion: 2.1 time: 0.408587 Jan 15 15:51:17.867115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 243/486] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 15:51:17 2022] DELETE /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 15:51:17.875008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:17.876724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:17.882923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.883721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.884771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.885194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.936089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5d4711a0-df28-4df6-b7e2-ccfa65a4ba84 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:17.937013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5d4711a0-df28-4df6-b7e2-ccfa65a4ba84 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:17.948395 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d4711a0-df28-4df6-b7e2-ccfa65a4ba84 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.948854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d4711a0-df28-4df6-b7e2-ccfa65a4ba84 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:17.949683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d4711a0-df28-4df6-b7e2-ccfa65a4ba84 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:17.950118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d4711a0-df28-4df6-b7e2-ccfa65a4ba84 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:18.082792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:18.088283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5d4711a0-df28-4df6-b7e2-ccfa65a4ba84 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.155877 Jan 15 15:51:18.093625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 244/487] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:17 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:18.105468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2543668b-fc59-42e6-8b36-383547dd5362 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:18.108017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-895564ab-9fbd-41ea-8bf6-36bdfe6c9549 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1469 microversion: 2.1 time: 0.236705 Jan 15 15:51:18.108848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 244/488] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:17 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1469 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:18.109088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2543668b-fc59-42e6-8b36-383547dd5362 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:18.116391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2543668b-fc59-42e6-8b36-383547dd5362 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:18.117319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2543668b-fc59-42e6-8b36-383547dd5362 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:18.118532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2543668b-fc59-42e6-8b36-383547dd5362 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:18.119189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2543668b-fc59-42e6-8b36-383547dd5362 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:18.210296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2543668b-fc59-42e6-8b36-383547dd5362 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.114033 Jan 15 15:51:18.211048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 245/489] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:18 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:18.530134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:18.530745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:18.539407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:18.540054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:18.541058 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:18.541491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:18.700394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:18.714133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ceaf3a00-7393-44de-897e-fb23313f25f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.199542 Jan 15 15:51:18.720260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 245/490] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:19.100456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-eb5258b7-3dd4-44b9-b116-3dee668908e5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:19.101516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-eb5258b7-3dd4-44b9-b116-3dee668908e5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:19.109636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb5258b7-3dd4-44b9-b116-3dee668908e5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.110096 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb5258b7-3dd4-44b9-b116-3dee668908e5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.111290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb5258b7-3dd4-44b9-b116-3dee668908e5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.111740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eb5258b7-3dd4-44b9-b116-3dee668908e5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.125507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:19.126977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:19.132354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.132806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.133582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.134017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.217313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-eb5258b7-3dd4-44b9-b116-3dee668908e5 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.121012 Jan 15 15:51:19.218132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 246/491] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:19 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:19.223248 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-196856e2-44bf-44fa-a0a3-adf63758c3ad tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:19.224264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-196856e2-44bf-44fa-a0a3-adf63758c3ad tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:19.231154 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-196856e2-44bf-44fa-a0a3-adf63758c3ad tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.236550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-196856e2-44bf-44fa-a0a3-adf63758c3ad tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.236550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-196856e2-44bf-44fa-a0a3-adf63758c3ad tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.236550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-196856e2-44bf-44fa-a0a3-adf63758c3ad tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.275907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:19.288609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d9239e33-2e41-467e-a050-fc188657e346 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1469 microversion: 2.1 time: 0.166560 Jan 15 15:51:19.289421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 246/492] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:19 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:19.303259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-196856e2-44bf-44fa-a0a3-adf63758c3ad tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.083803 Jan 15 15:51:19.304164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 247/493] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:19 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:19.731601 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:19.732347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:19.743505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.744437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.746960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:19.748088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:19.944453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:19.953011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-19c65ffa-e255-4ccd-9d52-7b9b320ebfe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.225520 Jan 15 15:51:19.954438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 247/494] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:20.231716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-043a2bb6-728a-4e22-8ef6-2c889183ff0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:20.233621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-043a2bb6-728a-4e22-8ef6-2c889183ff0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:20.242516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-043a2bb6-728a-4e22-8ef6-2c889183ff0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.242982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-043a2bb6-728a-4e22-8ef6-2c889183ff0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:20.244006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-043a2bb6-728a-4e22-8ef6-2c889183ff0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.244874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-043a2bb6-728a-4e22-8ef6-2c889183ff0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:20.306215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:20.307814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:20.315664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.316341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:20.316961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.317731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:20.409738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-043a2bb6-728a-4e22-8ef6-2c889183ff0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.183887 Jan 15 15:51:20.410716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 248/495] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:20 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:20.419282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-06357ba1-f431-47df-9ab9-e1a2e83d2ed5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:20.421643 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-06357ba1-f431-47df-9ab9-e1a2e83d2ed5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:20.430064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06357ba1-f431-47df-9ab9-e1a2e83d2ed5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.431364 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06357ba1-f431-47df-9ab9-e1a2e83d2ed5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:20.432331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06357ba1-f431-47df-9ab9-e1a2e83d2ed5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.433094 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06357ba1-f431-47df-9ab9-e1a2e83d2ed5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:20.491470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:20.503388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5528afab-2bb0-41b5-8bc1-a033bd375f69 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1469 microversion: 2.1 time: 0.200677 Jan 15 15:51:20.503974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 248/496] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:20 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:20.586358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-06357ba1-f431-47df-9ab9-e1a2e83d2ed5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.170478 Jan 15 15:51:20.587011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 249/497] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:20 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:20.977695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:20.979057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:20.990611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.991752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:20.992774 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:20.993397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.166393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:21.181006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-318a7aac-8b84-4624-8874-ab58a755c41a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.206700 Jan 15 15:51:21.182062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 249/498] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:21.270133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-e6f8937c-1557-458a-a704-60288d885d84 req-2bce5bb1-cded-40bf-aa0a-7a3625e9d160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245e1081-244c-45d8-80f0-7a89d4b3849c", "name": "network-vif-deleted", "tag": "dfe88715-11d9-4c79-9db5-a7376525ed52"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:21.275482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:51:21.275482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:51:21.317547 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-e6f8937c-1557-458a-a704-60288d885d84 req-2bce5bb1-cded-40bf-aa0a-7a3625e9d160 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.318642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-e6f8937c-1557-458a-a704-60288d885d84 req-2bce5bb1-cded-40bf-aa0a-7a3625e9d160 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.337800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-e6f8937c-1557-458a-a704-60288d885d84 req-2bce5bb1-cded-40bf-aa0a-7a3625e9d160 service nova] Creating event network-vif-deleted:dfe88715-11d9-4c79-9db5-a7376525ed52 for instance 245e1081-244c-45d8-80f0-7a89d4b3849c on hv-cinder-82481 Jan 15 15:51:21.342417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-e6f8937c-1557-458a-a704-60288d885d84 req-2bce5bb1-cded-40bf-aa0a-7a3625e9d160 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081183 Jan 15 15:51:21.343212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 250/499] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:51:21.421980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b9af28d5-c474-499a-8559-c548f4ec027b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:21.424384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b9af28d5-c474-499a-8559-c548f4ec027b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:21.444295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9af28d5-c474-499a-8559-c548f4ec027b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.446138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9af28d5-c474-499a-8559-c548f4ec027b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.447343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9af28d5-c474-499a-8559-c548f4ec027b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.447770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9af28d5-c474-499a-8559-c548f4ec027b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.521229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:21.522063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:21.528943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.529714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.530756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.531345 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.567889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.568366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.568989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.objects.instance [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lazy-loading 'fault' on Instance uuid 245e1081-244c-45d8-80f0-7a89d4b3849c {{(pid=123221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:51:21.613283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:21.622933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-743c1f9a-b079-4a27-b85d-d4a15103a44b tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1303 microversion: 2.1 time: 0.103697 Jan 15 15:51:21.633091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 251/500] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:21 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:21.640708 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7f584aa6-de58-4078-904f-c8db83276bde tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:21.641720 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7f584aa6-de58-4078-904f-c8db83276bde tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:21.648357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f584aa6-de58-4078-904f-c8db83276bde tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.648813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f584aa6-de58-4078-904f-c8db83276bde tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:21.649611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f584aa6-de58-4078-904f-c8db83276bde tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:21.650083 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7f584aa6-de58-4078-904f-c8db83276bde tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:24.575151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b9af28d5-c474-499a-8559-c548f4ec027b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 3.157024 Jan 15 15:51:24.575792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 250/501] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:21 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 3159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:24.581284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:24.581983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:24.594935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:24.594935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:24.594935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:24.594935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:24.722354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:24.730462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-51f3ddc2-a866-4525-b12f-836aed88929f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.153561 Jan 15 15:51:24.731024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 251/502] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:24.735794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:24.736428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:24.741879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:24.744104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:24.744104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:24.744104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:24.773793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:24.774241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:24.774682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lazy-loading 'fault' on Instance uuid 245e1081-244c-45d8-80f0-7a89d4b3849c {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:51:24.812369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:24.819417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-41da8d71-9924-4883-a728-12f8aa6c3d32 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1303 microversion: 2.1 time: 0.087467 Jan 15 15:51:24.819981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 252/503] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:24 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:25.587109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4307f9bc-be0d-4065-85f2-2e3506d417cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:25.588013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4307f9bc-be0d-4065-85f2-2e3506d417cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:25.594372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4307f9bc-be0d-4065-85f2-2e3506d417cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:25.595021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4307f9bc-be0d-4065-85f2-2e3506d417cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:25.595798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4307f9bc-be0d-4065-85f2-2e3506d417cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:25.596276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4307f9bc-be0d-4065-85f2-2e3506d417cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:25.965471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7f584aa6-de58-4078-904f-c8db83276bde tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 4.330845 Jan 15 15:51:25.966098 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 252/504] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:21 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 4332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:25.971097 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:25.971800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:25.972119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4307f9bc-be0d-4065-85f2-2e3506d417cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.388254 Jan 15 15:51:25.973244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 253/505] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:25 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:25.978545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:25.979262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:25.983773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:25.984450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:25.987945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:25.987945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:25.988362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:25.988362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:25.988362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:25.988764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:26.026769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:26.027218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:26.027675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lazy-loading 'fault' on Instance uuid 245e1081-244c-45d8-80f0-7a89d4b3849c {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:51:26.085331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:26.094801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8fb3fe07-ad04-4816-8014-fd7044fed98f tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1303 microversion: 2.1 time: 0.119272 Jan 15 15:51:26.095996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 254/506] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:25 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:26.181559 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:26.190674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e2f2a2d9-6e4e-4df4-99ec-9b4587540284 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.223423 Jan 15 15:51:26.191609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 253/507] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:26.977575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2979546a-7a38-408f-8e12-6b73b57aa802 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:26.978674 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2979546a-7a38-408f-8e12-6b73b57aa802 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:26.983637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5e25fec1-0738-4fb2-8fb9-bb69d9717013 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:26.988692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5e25fec1-0738-4fb2-8fb9-bb69d9717013 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:26.988843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2979546a-7a38-408f-8e12-6b73b57aa802 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:26.988843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2979546a-7a38-408f-8e12-6b73b57aa802 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:26.988843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2979546a-7a38-408f-8e12-6b73b57aa802 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:26.988843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2979546a-7a38-408f-8e12-6b73b57aa802 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:26.990984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e25fec1-0738-4fb2-8fb9-bb69d9717013 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:26.991446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e25fec1-0738-4fb2-8fb9-bb69d9717013 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:26.992326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e25fec1-0738-4fb2-8fb9-bb69d9717013 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:26.992774 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e25fec1-0738-4fb2-8fb9-bb69d9717013 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:27.085489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2979546a-7a38-408f-8e12-6b73b57aa802 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.111460 Jan 15 15:51:27.086553 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 255/508] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:26 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:27.094194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5e25fec1-0738-4fb2-8fb9-bb69d9717013 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.114029 Jan 15 15:51:27.095483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 254/509] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:26 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:27.112518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:27.113251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:27.119594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:27.120600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:27.120918 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:27.121348 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:27.153752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:27.154115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:27.154548 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lazy-loading 'fault' on Instance uuid 245e1081-244c-45d8-80f0-7a89d4b3849c {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:51:27.198452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90588c799023425e9d12db7c2199fae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d63abfeb44464b22e36625f62cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:27.212651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-95fd5d4a-8c78-45eb-aed6-aa8594d9ccbe tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 200 len: 1303 microversion: 2.1 time: 0.098788 Jan 15 15:51:27.212651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 256/510] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:27 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:27.212876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:27.212876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:27.215681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:27.216219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:27.217023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:27.217457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:27.372646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:27.381126 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-45420d7e-b9d6-4a6a-8fcb-0fcada4b6b0e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.178091 Jan 15 15:51:27.381680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 255/511] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:27.626392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-700f8384-8e2a-4160-982d-5ac4130a7e91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "392f28bd-8dd3-41c8-b0c0-a5b958d7922a", "device": "/dev/sdb"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:27.627971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-700f8384-8e2a-4160-982d-5ac4130a7e91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:27.633921 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-700f8384-8e2a-4160-982d-5ac4130a7e91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:27.634371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-700f8384-8e2a-4160-982d-5ac4130a7e91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:27.635157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-700f8384-8e2a-4160-982d-5ac4130a7e91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:27.635597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-700f8384-8e2a-4160-982d-5ac4130a7e91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.097501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6a817f56-1d2f-4f2a-a72f-9662ac3659f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:28.098376 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6a817f56-1d2f-4f2a-a72f-9662ac3659f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:28.104913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6a817f56-1d2f-4f2a-a72f-9662ac3659f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.105368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6a817f56-1d2f-4f2a-a72f-9662ac3659f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.106155 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6a817f56-1d2f-4f2a-a72f-9662ac3659f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.106596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6a817f56-1d2f-4f2a-a72f-9662ac3659f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.184719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6a817f56-1d2f-4f2a-a72f-9662ac3659f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.091186 Jan 15 15:51:28.185450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 256/512] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:28 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:28.190449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3b59f375-2497-457c-8444-60df82c668f8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:28.191432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3b59f375-2497-457c-8444-60df82c668f8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:28.198097 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b59f375-2497-457c-8444-60df82c668f8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.198543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b59f375-2497-457c-8444-60df82c668f8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.199314 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b59f375-2497-457c-8444-60df82c668f8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.199745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b59f375-2497-457c-8444-60df82c668f8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.313262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-700f8384-8e2a-4160-982d-5ac4130a7e91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "POST /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690838 Jan 15 15:51:28.313892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 257/513] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 15:51:27 2022] POST /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:51:28.318708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:28.320780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] [instance: 245e1081-244c-45d8-80f0-7a89d4b3849c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:28.325909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.326357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.327138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.327571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.341478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] HTTP exception thrown: Instance 245e1081-244c-45d8-80f0-7a89d4b3849c could not be found. Jan 15 15:51:28.343595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] Returning 404 to user: Instance 245e1081-244c-45d8-80f0-7a89d4b3849c could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:51:28.343595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5296bba3-79e8-40de-8c9b-25fe54c5eaf4 tempest-VolumesNegativeTest-500313982 tempest-VolumesNegativeTest-500313982-project] 10.222.0.36 "GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c" status: 404 len: 111 microversion: 2.1 time: 0.027916 Jan 15 15:51:28.343595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 258/514] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:28 2022] GET /compute/v2.1/servers/245e1081-244c-45d8-80f0-7a89d4b3849c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:51:28.398308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:28.402392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:28.405921 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.406503 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.408353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:28.409001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:28.551632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:28.559251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-944f1399-9799-490a-b214-10088abd210b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.165095 Jan 15 15:51:28.559907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 259/515] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:28.878374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3b59f375-2497-457c-8444-60df82c668f8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.691367 Jan 15 15:51:28.879032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 257/516] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:28 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:29.195970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3ea62206-588c-47bd-8727-52260f84164f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:29.196981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3ea62206-588c-47bd-8727-52260f84164f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:29.203181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ea62206-588c-47bd-8727-52260f84164f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:29.203910 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ea62206-588c-47bd-8727-52260f84164f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:29.204933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ea62206-588c-47bd-8727-52260f84164f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:29.205371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ea62206-588c-47bd-8727-52260f84164f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:29.577577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:29.578443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:29.588733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:29.589200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:29.590001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:29.594523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:29.897843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:29.906308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0820e5ac-bda7-4f4f-9364-96da7421f400 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.332694 Jan 15 15:51:29.907670 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 258/517] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:29.912271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1c0302b3-1658-435f-b5eb-fff54afdef69 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:29.913190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1c0302b3-1658-435f-b5eb-fff54afdef69 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:29.919210 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c0302b3-1658-435f-b5eb-fff54afdef69 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:29.919665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c0302b3-1658-435f-b5eb-fff54afdef69 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:29.920483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c0302b3-1658-435f-b5eb-fff54afdef69 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:29.920928 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1c0302b3-1658-435f-b5eb-fff54afdef69 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:32.574109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1c0302b3-1658-435f-b5eb-fff54afdef69 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 2.665101 Jan 15 15:51:32.574868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 259/518] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:29 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:32.576523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3ea62206-588c-47bd-8727-52260f84164f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 3.383446 Jan 15 15:51:32.580256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:32.581888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:32.583489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 260/519] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:29 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 3392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:32.592969 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:32.593416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:32.595011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:32.596652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:32.743120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:32.751427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ac47506b-5077-4287-8993-3836693f31d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.175598 Jan 15 15:51:32.752591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 260/520] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:33.587193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e5d3729c-8917-4d01-93bc-8821440231df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:33.588110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e5d3729c-8917-4d01-93bc-8821440231df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:33.590511 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3f674332-3e49-4392-a9ce-ad99389dd143 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:33.591432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3f674332-3e49-4392-a9ce-ad99389dd143 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:33.595056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5d3729c-8917-4d01-93bc-8821440231df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:33.596014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5d3729c-8917-4d01-93bc-8821440231df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:33.596829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5d3729c-8917-4d01-93bc-8821440231df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:33.597266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5d3729c-8917-4d01-93bc-8821440231df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:33.598472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f674332-3e49-4392-a9ce-ad99389dd143 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:33.598929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f674332-3e49-4392-a9ce-ad99389dd143 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:33.599719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f674332-3e49-4392-a9ce-ad99389dd143 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:33.600181 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f674332-3e49-4392-a9ce-ad99389dd143 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:33.672288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3f674332-3e49-4392-a9ce-ad99389dd143 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.085041 Jan 15 15:51:33.674358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 261/521] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:33 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:33.676713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e5d3729c-8917-4d01-93bc-8821440231df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.093502 Jan 15 15:51:33.677353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 261/522] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:33 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:33.769912 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:33.770607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:33.777419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:33.777866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:33.778638 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:33.779075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:33.907204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:33.917085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5a75fe26-3da4-4501-9e7f-c44901b7a3e5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.151896 Jan 15 15:51:33.917668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 262/523] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:34.687738 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-baa1bd5a-221f-4a21-86b1-6359946a4bb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:34.689349 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-baa1bd5a-221f-4a21-86b1-6359946a4bb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:34.692816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b9e85eff-aac1-49c2-81cf-60f321626fdb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:34.694311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b9e85eff-aac1-49c2-81cf-60f321626fdb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:34.701683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-baa1bd5a-221f-4a21-86b1-6359946a4bb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:34.703285 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-baa1bd5a-221f-4a21-86b1-6359946a4bb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:34.703751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-baa1bd5a-221f-4a21-86b1-6359946a4bb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:34.704492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-baa1bd5a-221f-4a21-86b1-6359946a4bb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:34.704630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9e85eff-aac1-49c2-81cf-60f321626fdb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:34.705353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9e85eff-aac1-49c2-81cf-60f321626fdb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:34.706660 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9e85eff-aac1-49c2-81cf-60f321626fdb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:34.707719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9e85eff-aac1-49c2-81cf-60f321626fdb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:34.827242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-baa1bd5a-221f-4a21-86b1-6359946a4bb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.146069 Jan 15 15:51:34.828230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 262/524] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:34 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:34.860611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b9e85eff-aac1-49c2-81cf-60f321626fdb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.174840 Jan 15 15:51:34.867388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 263/525] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:34 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:34.934827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:34.935970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:34.950925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:34.951544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:34.954845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:34.955307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:35.131417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:35.139723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c7b71d6f-2c89-47e3-bc50-9fbbbe57bc0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.208278 Jan 15 15:51:35.139723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 263/526] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:35.846414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d19abe63-587b-4591-b0ed-d57e68515368 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:35.847634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d19abe63-587b-4591-b0ed-d57e68515368 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:35.854518 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d19abe63-587b-4591-b0ed-d57e68515368 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:35.855272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d19abe63-587b-4591-b0ed-d57e68515368 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:35.856443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d19abe63-587b-4591-b0ed-d57e68515368 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:35.857214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d19abe63-587b-4591-b0ed-d57e68515368 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:35.873979 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c8eed697-750d-4fd9-a7fd-2fd820bf38e3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:35.874894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c8eed697-750d-4fd9-a7fd-2fd820bf38e3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:35.883691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8eed697-750d-4fd9-a7fd-2fd820bf38e3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:35.884163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8eed697-750d-4fd9-a7fd-2fd820bf38e3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:35.884952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8eed697-750d-4fd9-a7fd-2fd820bf38e3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:35.885633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8eed697-750d-4fd9-a7fd-2fd820bf38e3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:35.957338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d19abe63-587b-4591-b0ed-d57e68515368 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.114872 Jan 15 15:51:35.960187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 264/527] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:35 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:35.987384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c8eed697-750d-4fd9-a7fd-2fd820bf38e3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.116625 Jan 15 15:51:35.989441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 264/528] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:35 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:36.157028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:36.157839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:36.165227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:36.165778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:36.166433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:36.166871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:36.308658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:36.328512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-54698be2-352b-493b-91ad-f69a401f9e99 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.163457 Jan 15 15:51:36.328512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 265/529] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:36.969101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-56cc7a5c-4fc4-4d96-9430-2abb1f7a1f81 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:36.970169 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-56cc7a5c-4fc4-4d96-9430-2abb1f7a1f81 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:36.979977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56cc7a5c-4fc4-4d96-9430-2abb1f7a1f81 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:36.980459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56cc7a5c-4fc4-4d96-9430-2abb1f7a1f81 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:36.981248 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56cc7a5c-4fc4-4d96-9430-2abb1f7a1f81 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:36.981680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56cc7a5c-4fc4-4d96-9430-2abb1f7a1f81 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:37.000133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cc804467-c1d4-4b9a-af2a-ddfd3d6ba1eb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:37.000652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cc804467-c1d4-4b9a-af2a-ddfd3d6ba1eb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:37.007235 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc804467-c1d4-4b9a-af2a-ddfd3d6ba1eb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:37.007778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc804467-c1d4-4b9a-af2a-ddfd3d6ba1eb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:37.009290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc804467-c1d4-4b9a-af2a-ddfd3d6ba1eb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:37.009767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc804467-c1d4-4b9a-af2a-ddfd3d6ba1eb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:39.720964 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-56cc7a5c-4fc4-4d96-9430-2abb1f7a1f81 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 2.756121 Jan 15 15:51:39.721867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 265/530] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:36 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:39.727382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:39.728074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:39.735451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:39.735899 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:39.736708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:39.737146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:39.762278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cc804467-c1d4-4b9a-af2a-ddfd3d6ba1eb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 2.766616 Jan 15 15:51:39.766448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 266/531] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:36 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 2768 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:39.863752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:39.871894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-66afeacf-5c03-4645-8b64-36b4b11ddcfa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.148339 Jan 15 15:51:39.872489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 266/532] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:40.734357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b631b1cf-37c7-4e06-b8c5-a630b1726027 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:40.735396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b631b1cf-37c7-4e06-b8c5-a630b1726027 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:40.742722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b631b1cf-37c7-4e06-b8c5-a630b1726027 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:40.743178 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b631b1cf-37c7-4e06-b8c5-a630b1726027 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:40.744003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b631b1cf-37c7-4e06-b8c5-a630b1726027 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:40.744606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b631b1cf-37c7-4e06-b8c5-a630b1726027 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:40.775197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ed13b5b1-5be8-4528-b6e9-0cdc3d601ea0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:40.776128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ed13b5b1-5be8-4528-b6e9-0cdc3d601ea0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:40.782595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed13b5b1-5be8-4528-b6e9-0cdc3d601ea0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:40.783040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed13b5b1-5be8-4528-b6e9-0cdc3d601ea0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:40.783814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed13b5b1-5be8-4528-b6e9-0cdc3d601ea0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:40.784285 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed13b5b1-5be8-4528-b6e9-0cdc3d601ea0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:40.865428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b631b1cf-37c7-4e06-b8c5-a630b1726027 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.134239 Jan 15 15:51:40.866681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 267/533] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:40 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:40.886275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ed13b5b1-5be8-4528-b6e9-0cdc3d601ea0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.115371 Jan 15 15:51:40.886946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 267/534] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:40 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:40.890863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:40.891558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:40.899014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:40.899459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:40.900362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:40.900802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:41.035634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:41.044567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3fc71abf-bc15-434a-9f5d-bc3749247276 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.159106 Jan 15 15:51:41.047964 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 268/535] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:41.878511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cce10c1b-7dbe-49e4-9e00-d665bcd86dff tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:41.879686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cce10c1b-7dbe-49e4-9e00-d665bcd86dff tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:41.888113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cce10c1b-7dbe-49e4-9e00-d665bcd86dff tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:41.889076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cce10c1b-7dbe-49e4-9e00-d665bcd86dff tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:41.890091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cce10c1b-7dbe-49e4-9e00-d665bcd86dff tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:41.890740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cce10c1b-7dbe-49e4-9e00-d665bcd86dff tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:41.903588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a2d0f28b-377d-44e9-9115-42eb70ad3721 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:41.904551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a2d0f28b-377d-44e9-9115-42eb70ad3721 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:41.913095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2d0f28b-377d-44e9-9115-42eb70ad3721 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:41.913095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2d0f28b-377d-44e9-9115-42eb70ad3721 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:41.913095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2d0f28b-377d-44e9-9115-42eb70ad3721 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:41.913367 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2d0f28b-377d-44e9-9115-42eb70ad3721 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:41.973067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cce10c1b-7dbe-49e4-9e00-d665bcd86dff tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.099012 Jan 15 15:51:41.974392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 268/536] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:41 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:41.982373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a2d0f28b-377d-44e9-9115-42eb70ad3721 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.082798 Jan 15 15:51:41.986346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 269/537] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:41 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:42.063184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:42.063889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:42.071189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.071642 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.072645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.073086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.206485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:42.214911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fd37b341-fa24-41f3-8648-0b67377d54f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1547 microversion: 2.1 time: 0.155727 Jan 15 15:51:42.215471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 269/538] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:42.232862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:42.233568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:42.241369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.241828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.242772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.243390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.475318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] HTTP exception thrown: Cannot 'detach_volume' instance ba9275a1-4d53-4571-be72-2b4524364e4a while it is in vm_state rescued Jan 15 15:51:42.475939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Returning 409 to user: Cannot 'detach_volume' instance ba9275a1-4d53-4571-be72-2b4524364e4a while it is in vm_state rescued {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:51:42.476821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-98d1c4f1-320d-4029-ae81-dd94c7a101a5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments/6dc95756-bdc1-4049-b6ea-f95b127dca76" status: 409 len: 152 microversion: 2.1 time: 0.248299 Jan 15 15:51:42.477377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 270/539] 10.222.0.36 () {58 vars in 1415 bytes} [Sat Jan 15 15:51:42 2022] DELETE /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments/6dc95756-bdc1-4049-b6ea-f95b127dca76 => generated 152 bytes in 250 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 15:51:42.485590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7f99e9ae-6f95-4312-8b7d-64abf9385d09 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:42.486117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7f99e9ae-6f95-4312-8b7d-64abf9385d09 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:42.492725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f99e9ae-6f95-4312-8b7d-64abf9385d09 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.496579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f99e9ae-6f95-4312-8b7d-64abf9385d09 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.496579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f99e9ae-6f95-4312-8b7d-64abf9385d09 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.496579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f99e9ae-6f95-4312-8b7d-64abf9385d09 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.712464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7f99e9ae-6f95-4312-8b7d-64abf9385d09 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action" status: 202 len: 0 microversion: 2.1 time: 0.230277 Jan 15 15:51:42.713155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 270/540] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:42 2022] POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:42.722175 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:42.722485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:42.729600 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.730051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.730905 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.731342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.870847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:42.878590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-15f09e96-ba3a-4d4a-b889-870d9e8f7c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.160345 Jan 15 15:51:42.879156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 271/541] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:42.986492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-135d0426-3599-4b0b-b94b-e9f4febc1813 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:42.987518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-135d0426-3599-4b0b-b94b-e9f4febc1813 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:42.994353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-523895c2-5c8e-438b-a479-75fa3037dad8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:42.994790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-135d0426-3599-4b0b-b94b-e9f4febc1813 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.994790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-135d0426-3599-4b0b-b94b-e9f4febc1813 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:42.995335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-523895c2-5c8e-438b-a479-75fa3037dad8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:42.995574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-135d0426-3599-4b0b-b94b-e9f4febc1813 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:42.996008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-135d0426-3599-4b0b-b94b-e9f4febc1813 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:43.001609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-523895c2-5c8e-438b-a479-75fa3037dad8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:43.002051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-523895c2-5c8e-438b-a479-75fa3037dad8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:43.002870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-523895c2-5c8e-438b-a479-75fa3037dad8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:43.003312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-523895c2-5c8e-438b-a479-75fa3037dad8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:43.109721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-135d0426-3599-4b0b-b94b-e9f4febc1813 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.127395 Jan 15 15:51:43.110375 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 271/542] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:42 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:43.116460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-523895c2-5c8e-438b-a479-75fa3037dad8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.125593 Jan 15 15:51:43.120271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 272/543] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:42 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:43.898126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:43.898819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:43.905551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:43.905994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:43.906791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:43.907221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:44.038790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:44.047328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-03f1a983-e683-4080-ba43-6ffcb94ffc78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.154057 Jan 15 15:51:44.047890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 272/544] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:44.122616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3157f3ae-2d27-45a8-8a09-cedd3b2d6a61 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:44.123508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3157f3ae-2d27-45a8-8a09-cedd3b2d6a61 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:44.127958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ad59de5a-9cc3-45b8-922a-4aa87587d92f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:44.128907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ad59de5a-9cc3-45b8-922a-4aa87587d92f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:44.131452 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3157f3ae-2d27-45a8-8a09-cedd3b2d6a61 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:44.132171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3157f3ae-2d27-45a8-8a09-cedd3b2d6a61 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:44.132723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3157f3ae-2d27-45a8-8a09-cedd3b2d6a61 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:44.133166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3157f3ae-2d27-45a8-8a09-cedd3b2d6a61 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:44.135242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad59de5a-9cc3-45b8-922a-4aa87587d92f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:44.135697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad59de5a-9cc3-45b8-922a-4aa87587d92f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:44.136504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad59de5a-9cc3-45b8-922a-4aa87587d92f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:44.136952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad59de5a-9cc3-45b8-922a-4aa87587d92f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:46.321283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3157f3ae-2d27-45a8-8a09-cedd3b2d6a61 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 2.202608 Jan 15 15:51:46.325069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 273/545] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:44 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:46.326609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:46.327323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:46.330851 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ad59de5a-9cc3-45b8-922a-4aa87587d92f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 2.206563 Jan 15 15:51:46.331841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 273/546] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:44 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:46.334886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:46.335340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:46.336133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:46.336602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:46.466468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:46.475550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3fdd1e18-f6a1-4d86-88cb-7e259dbbb1b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.152543 Jan 15 15:51:46.476311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 274/547] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:47.333464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5ad789c1-894f-4be4-88b5-e65ef2cd7b8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:47.334414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5ad789c1-894f-4be4-88b5-e65ef2cd7b8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:47.341685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ad789c1-894f-4be4-88b5-e65ef2cd7b8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:47.350238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5ead48ea-6686-4c5d-8ff2-b02f57b46324 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:47.350710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ad789c1-894f-4be4-88b5-e65ef2cd7b8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:47.350807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5ead48ea-6686-4c5d-8ff2-b02f57b46324 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:47.350885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ad789c1-894f-4be4-88b5-e65ef2cd7b8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:47.350885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ad789c1-894f-4be4-88b5-e65ef2cd7b8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:47.351063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ead48ea-6686-4c5d-8ff2-b02f57b46324 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:47.351063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ead48ea-6686-4c5d-8ff2-b02f57b46324 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:47.351063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ead48ea-6686-4c5d-8ff2-b02f57b46324 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:47.351255 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ead48ea-6686-4c5d-8ff2-b02f57b46324 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:51.543131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5ead48ea-6686-4c5d-8ff2-b02f57b46324 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 4.204541 Jan 15 15:51:51.543811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 275/548] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:47 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 4206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:51.548576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:51.549278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:51.549745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5ad789c1-894f-4be4-88b5-e65ef2cd7b8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 4.220328 Jan 15 15:51:51.552181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 274/549] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:47 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 4222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:51.557286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:51.557736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:51.558522 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:51.559086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:51.690762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:51.699227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-faa86d50-a83f-4fda-9e8f-7ee4701ff36a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.154422 Jan 15 15:51:51.699792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 276/550] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:52.555671 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1a97aa41-4b21-4715-b1e9-2252a1f80b0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:52.556909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1a97aa41-4b21-4715-b1e9-2252a1f80b0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:52.562215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0db1378a-e350-490f-b07c-a3323e2529fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:52.563138 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0db1378a-e350-490f-b07c-a3323e2529fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:52.564844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a97aa41-4b21-4715-b1e9-2252a1f80b0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:52.565297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a97aa41-4b21-4715-b1e9-2252a1f80b0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:52.566091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a97aa41-4b21-4715-b1e9-2252a1f80b0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:52.566530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a97aa41-4b21-4715-b1e9-2252a1f80b0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:52.569673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0db1378a-e350-490f-b07c-a3323e2529fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:52.570155 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0db1378a-e350-490f-b07c-a3323e2529fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:52.570997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0db1378a-e350-490f-b07c-a3323e2529fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:52.571444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0db1378a-e350-490f-b07c-a3323e2529fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:52.630529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1a97aa41-4b21-4715-b1e9-2252a1f80b0c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.079065 Jan 15 15:51:52.631158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 275/551] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:52 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:52.651875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0db1378a-e350-490f-b07c-a3323e2529fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.093719 Jan 15 15:51:52.653172 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 277/552] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:52 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:52.716995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:52.717689 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:52.724656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:52.725101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:52.725973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:52.726407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:52.856757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:52.864528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8a2931c4-2446-4e1a-97b7-1856bbec4b48 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.151445 Jan 15 15:51:52.865097 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 276/553] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:53.642970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ef3044e3-b972-4adf-b609-983b7acdba0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:53.643974 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ef3044e3-b972-4adf-b609-983b7acdba0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:53.651125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef3044e3-b972-4adf-b609-983b7acdba0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:53.653262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef3044e3-b972-4adf-b609-983b7acdba0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:53.653262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef3044e3-b972-4adf-b609-983b7acdba0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:53.653262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef3044e3-b972-4adf-b609-983b7acdba0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:53.664171 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e5e9c028-ccb2-4279-ac2b-e6a5c177a883 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:53.665362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e5e9c028-ccb2-4279-ac2b-e6a5c177a883 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:53.672286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5e9c028-ccb2-4279-ac2b-e6a5c177a883 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:53.676323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5e9c028-ccb2-4279-ac2b-e6a5c177a883 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:53.676323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5e9c028-ccb2-4279-ac2b-e6a5c177a883 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:53.676323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5e9c028-ccb2-4279-ac2b-e6a5c177a883 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:53.771077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ef3044e3-b972-4adf-b609-983b7acdba0b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.131833 Jan 15 15:51:53.771737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 278/554] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:53 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:53.786089 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e5e9c028-ccb2-4279-ac2b-e6a5c177a883 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.126362 Jan 15 15:51:53.786715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 277/555] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:53 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:51:53.882289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:53.883102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:53.889918 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:53.890384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:53.891164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:53.891599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:54.022646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:54.031285 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-35f026ee-eaf2-4d97-8b96-0e733b026ffa tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.153469 Jan 15 15:51:54.031858 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 279/556] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:54.783319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-78781d64-0f50-476f-8ce0-cba8f3d57d1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:54.784371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-78781d64-0f50-476f-8ce0-cba8f3d57d1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:54.791244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78781d64-0f50-476f-8ce0-cba8f3d57d1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:54.791740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78781d64-0f50-476f-8ce0-cba8f3d57d1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:54.792820 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78781d64-0f50-476f-8ce0-cba8f3d57d1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:54.793590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-78781d64-0f50-476f-8ce0-cba8f3d57d1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:54.798141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a10451a1-9f26-4604-b756-927b91dc4200 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:54.799134 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a10451a1-9f26-4604-b756-927b91dc4200 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:54.806567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a10451a1-9f26-4604-b756-927b91dc4200 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:54.807089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a10451a1-9f26-4604-b756-927b91dc4200 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:54.807944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a10451a1-9f26-4604-b756-927b91dc4200 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:54.808466 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a10451a1-9f26-4604-b756-927b91dc4200 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:55.124574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-78781d64-0f50-476f-8ce0-cba8f3d57d1f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.345128 Jan 15 15:51:55.127651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 278/557] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:54 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:51:55.130996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:55.132084 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:55.138721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:55.139175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:55.139968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:55.140433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:55.304094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:55.311908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-39295387-3d53-4a81-b261-d80d0b99fa52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.185410 Jan 15 15:51:55.312533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 279/558] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:56.137564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-297c39f3-27f6-4727-9a95-110143a0471f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:56.138568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-297c39f3-27f6-4727-9a95-110143a0471f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:56.144924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-297c39f3-27f6-4727-9a95-110143a0471f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:56.145448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-297c39f3-27f6-4727-9a95-110143a0471f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:56.146295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-297c39f3-27f6-4727-9a95-110143a0471f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:56.146799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-297c39f3-27f6-4727-9a95-110143a0471f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:56.198995 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a10451a1-9f26-4604-b756-927b91dc4200 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 1.404503 Jan 15 15:51:56.199722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 280/559] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:54 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:56.329084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:56.329789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:56.336689 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:56.337146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:56.337952 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:56.338428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:56.469575 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:56.478151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b1a7f986-e87e-4fec-88f3-fe5da2944b9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.153161 Jan 15 15:51:56.479099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 281/560] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:57.210170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-462937bb-ec19-4480-a7ea-1f030b374269 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:57.211864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-462937bb-ec19-4480-a7ea-1f030b374269 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:57.218100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-462937bb-ec19-4480-a7ea-1f030b374269 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:57.218561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-462937bb-ec19-4480-a7ea-1f030b374269 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:57.219342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-462937bb-ec19-4480-a7ea-1f030b374269 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:57.219779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-462937bb-ec19-4480-a7ea-1f030b374269 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:58.640051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-297c39f3-27f6-4727-9a95-110143a0471f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 2.506198 Jan 15 15:51:58.640722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 280/561] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:56 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:51:58.645664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:58.646420 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:58.653915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:58.654362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:58.655146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:58.655584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:58.785296 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:58.794502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-60ba5576-46d0-4261-95da-39957b0b1f8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1555 microversion: 2.1 time: 0.152595 Jan 15 15:51:58.795017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 281/562] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:51:58.803513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-462937bb-ec19-4480-a7ea-1f030b374269 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 1.596719 Jan 15 15:51:58.804502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 282/563] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:57 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:51:59.651923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0ff55654-948c-458e-a56c-7aac0a31b411 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:59.652867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0ff55654-948c-458e-a56c-7aac0a31b411 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:59.659087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ff55654-948c-458e-a56c-7aac0a31b411 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:59.659544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ff55654-948c-458e-a56c-7aac0a31b411 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:59.660352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ff55654-948c-458e-a56c-7aac0a31b411 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:59.660790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ff55654-948c-458e-a56c-7aac0a31b411 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:59.812686 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:51:59.813446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:59.820692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:59.821150 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:59.821936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:59.822377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:59.954565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:51:59.962898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d4acb86c-ccf4-4ac9-b2a8-3d0fa03fdf8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1561 microversion: 2.1 time: 0.154212 Jan 15 15:51:59.963449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 283/564] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:51:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:51:59.968114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7204f1e8-4ed2-489c-a216-3d447a2a36dc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:51:59.969036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7204f1e8-4ed2-489c-a216-3d447a2a36dc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:51:59.974601 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7204f1e8-4ed2-489c-a216-3d447a2a36dc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:59.975072 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7204f1e8-4ed2-489c-a216-3d447a2a36dc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:51:59.975839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7204f1e8-4ed2-489c-a216-3d447a2a36dc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:51:59.976478 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7204f1e8-4ed2-489c-a216-3d447a2a36dc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:00.188590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0ff55654-948c-458e-a56c-7aac0a31b411 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.540704 Jan 15 15:52:00.189248 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 282/565] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:51:59 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:00.194313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:00.195443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:00.202967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:00.203277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:00.204410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:00.204875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:00.331437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lazy-loading 'services' on Instance uuid ba9275a1-4d53-4571-be72-2b4524364e4a {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:52:00.552102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f172ebd8-d388-4f05-bdab-33448fbfba15 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments/6dc95756-bdc1-4049-b6ea-f95b127dca76" status: 202 len: 0 microversion: 2.1 time: 0.361337 Jan 15 15:52:00.552719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 283/566] 10.222.0.36 () {58 vars in 1415 bytes} [Sat Jan 15 15:52:00 2022] DELETE /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments/6dc95756-bdc1-4049-b6ea-f95b127dca76 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:00.560837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e2b19267-15c5-4373-9a1c-938a9bee2bbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:00.561876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e2b19267-15c5-4373-9a1c-938a9bee2bbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:00.572212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2b19267-15c5-4373-9a1c-938a9bee2bbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:00.572666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2b19267-15c5-4373-9a1c-938a9bee2bbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:00.573449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2b19267-15c5-4373-9a1c-938a9bee2bbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:00.573912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2b19267-15c5-4373-9a1c-938a9bee2bbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:00.603608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e2b19267-15c5-4373-9a1c-938a9bee2bbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046507 Jan 15 15:52:00.604184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 284/567] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:01.110159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7204f1e8-4ed2-489c-a216-3d447a2a36dc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 1.145290 Jan 15 15:52:01.111442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 284/568] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:51:59 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:01.199926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-32a42e5b-ccd4-4de2-9897-11db2eb1e69c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:01.200942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-32a42e5b-ccd4-4de2-9897-11db2eb1e69c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:01.207320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a42e5b-ccd4-4de2-9897-11db2eb1e69c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:01.207772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a42e5b-ccd4-4de2-9897-11db2eb1e69c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:01.208578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a42e5b-ccd4-4de2-9897-11db2eb1e69c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:01.209018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a42e5b-ccd4-4de2-9897-11db2eb1e69c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:01.615260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-40b403fc-a38b-4105-a4fb-2936b3bf8778 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:01.616329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-40b403fc-a38b-4105-a4fb-2936b3bf8778 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:01.623632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b403fc-a38b-4105-a4fb-2936b3bf8778 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:01.623984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b403fc-a38b-4105-a4fb-2936b3bf8778 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:01.624819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b403fc-a38b-4105-a4fb-2936b3bf8778 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:01.625260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b403fc-a38b-4105-a4fb-2936b3bf8778 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:01.656207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-40b403fc-a38b-4105-a4fb-2936b3bf8778 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Jan 15 15:52:01.656767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 285/569] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:02.122173 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e76046bd-0720-476a-b243-2d3552fc0346 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:02.123007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e76046bd-0720-476a-b243-2d3552fc0346 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:02.129249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e76046bd-0720-476a-b243-2d3552fc0346 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:02.129693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e76046bd-0720-476a-b243-2d3552fc0346 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:02.130464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e76046bd-0720-476a-b243-2d3552fc0346 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:02.130896 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e76046bd-0720-476a-b243-2d3552fc0346 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:03.396167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-32a42e5b-ccd4-4de2-9897-11db2eb1e69c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 2.199784 Jan 15 15:52:03.399306 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 285/570] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:01 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:03.401860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e76046bd-0720-476a-b243-2d3552fc0346 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 1.283872 Jan 15 15:52:03.403652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 286/571] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:02 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:03.408479 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-56f39a55-b9ed-4b6c-9274-d4d31ed58fe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:03.409429 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-56f39a55-b9ed-4b6c-9274-d4d31ed58fe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:03.416223 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56f39a55-b9ed-4b6c-9274-d4d31ed58fe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:03.417640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56f39a55-b9ed-4b6c-9274-d4d31ed58fe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:03.417766 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56f39a55-b9ed-4b6c-9274-d4d31ed58fe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:03.418126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56f39a55-b9ed-4b6c-9274-d4d31ed58fe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:03.452451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-56f39a55-b9ed-4b6c-9274-d4d31ed58fe5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048880 Jan 15 15:52:03.453067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 286/572] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:04.409202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5b12c81c-329d-4144-a11a-0baf83f538cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:04.410203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5b12c81c-329d-4144-a11a-0baf83f538cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:04.413061 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-393aff70-7f3a-45a0-b7bc-7b9f83d33406 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:04.414007 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-393aff70-7f3a-45a0-b7bc-7b9f83d33406 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:04.418277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b12c81c-329d-4144-a11a-0baf83f538cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:04.418730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b12c81c-329d-4144-a11a-0baf83f538cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:04.419518 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b12c81c-329d-4144-a11a-0baf83f538cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:04.419952 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b12c81c-329d-4144-a11a-0baf83f538cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:04.421398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-393aff70-7f3a-45a0-b7bc-7b9f83d33406 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:04.421867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-393aff70-7f3a-45a0-b7bc-7b9f83d33406 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:04.422643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-393aff70-7f3a-45a0-b7bc-7b9f83d33406 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:04.423088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-393aff70-7f3a-45a0-b7bc-7b9f83d33406 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:04.482546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5b12c81c-329d-4144-a11a-0baf83f538cd tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.077092 Jan 15 15:52:04.488712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 287/573] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:04 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:04.488712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bb0695e9-2875-477d-8df8-3e0420a70eed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:04.489141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bb0695e9-2875-477d-8df8-3e0420a70eed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:04.496010 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb0695e9-2875-477d-8df8-3e0420a70eed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:04.496496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb0695e9-2875-477d-8df8-3e0420a70eed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:04.497296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb0695e9-2875-477d-8df8-3e0420a70eed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:04.497744 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb0695e9-2875-477d-8df8-3e0420a70eed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:04.509048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-393aff70-7f3a-45a0-b7bc-7b9f83d33406 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.099509 Jan 15 15:52:04.514138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 287/574] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:04 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:04.528187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bb0695e9-2875-477d-8df8-3e0420a70eed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 Jan 15 15:52:04.528795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 288/575] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:05.495433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-475ab23e-5add-461c-ae85-4c50e40155fe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:05.500053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-475ab23e-5add-461c-ae85-4c50e40155fe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:05.503260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-475ab23e-5add-461c-ae85-4c50e40155fe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:05.503720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-475ab23e-5add-461c-ae85-4c50e40155fe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:05.504544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-475ab23e-5add-461c-ae85-4c50e40155fe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:05.505011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-475ab23e-5add-461c-ae85-4c50e40155fe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:05.519836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3153dba3-d6f8-4e0f-9075-b5f5a7a1b565 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:05.520989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3153dba3-d6f8-4e0f-9075-b5f5a7a1b565 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:05.529057 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3153dba3-d6f8-4e0f-9075-b5f5a7a1b565 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:05.529517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3153dba3-d6f8-4e0f-9075-b5f5a7a1b565 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:05.530301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3153dba3-d6f8-4e0f-9075-b5f5a7a1b565 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:05.530738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3153dba3-d6f8-4e0f-9075-b5f5a7a1b565 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:05.572334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-475ab23e-5add-461c-ae85-4c50e40155fe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.081052 Jan 15 15:52:05.572933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 288/576] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:05 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:05.578832 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0e52c45f-c046-449c-9809-b44835c9b972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:05.578962 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0e52c45f-c046-449c-9809-b44835c9b972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:05.585793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e52c45f-c046-449c-9809-b44835c9b972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:05.586248 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e52c45f-c046-449c-9809-b44835c9b972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:05.587468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e52c45f-c046-449c-9809-b44835c9b972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:05.587913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e52c45f-c046-449c-9809-b44835c9b972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:05.617702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0e52c45f-c046-449c-9809-b44835c9b972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 Jan 15 15:52:05.618825 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 289/577] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:05.619254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3153dba3-d6f8-4e0f-9075-b5f5a7a1b565 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.102155 Jan 15 15:52:05.620024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 289/578] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:05 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:06.586270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1951e92a-47a5-45be-aec1-8b62e060c11b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:06.587314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1951e92a-47a5-45be-aec1-8b62e060c11b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:06.593619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1951e92a-47a5-45be-aec1-8b62e060c11b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:06.594073 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1951e92a-47a5-45be-aec1-8b62e060c11b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:06.594869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1951e92a-47a5-45be-aec1-8b62e060c11b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:06.595322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1951e92a-47a5-45be-aec1-8b62e060c11b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:06.630091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-abf7b362-346c-4bd4-b3c7-29211f2f50ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:06.631099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-abf7b362-346c-4bd4-b3c7-29211f2f50ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:06.638561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abf7b362-346c-4bd4-b3c7-29211f2f50ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:06.639019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abf7b362-346c-4bd4-b3c7-29211f2f50ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:06.639804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abf7b362-346c-4bd4-b3c7-29211f2f50ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:06.640278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abf7b362-346c-4bd4-b3c7-29211f2f50ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:06.655698 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1951e92a-47a5-45be-aec1-8b62e060c11b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.072965 Jan 15 15:52:06.659525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 290/579] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:06 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:06.661215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2ca1a660-2bab-4f0b-9f66-9f328152e6fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:06.662192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2ca1a660-2bab-4f0b-9f66-9f328152e6fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:06.669316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca1a660-2bab-4f0b-9f66-9f328152e6fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:06.669763 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca1a660-2bab-4f0b-9f66-9f328152e6fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:06.670544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca1a660-2bab-4f0b-9f66-9f328152e6fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:06.670971 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-abf7b362-346c-4bd4-b3c7-29211f2f50ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Jan 15 15:52:06.671099 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca1a660-2bab-4f0b-9f66-9f328152e6fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:06.671531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 290/580] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:06.739827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2ca1a660-2bab-4f0b-9f66-9f328152e6fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.082106 Jan 15 15:52:06.740490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 291/581] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:06 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:07.667668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-be321bc8-d692-467a-9ec1-eab2c6631743 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:07.668617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-be321bc8-d692-467a-9ec1-eab2c6631743 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:07.674893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be321bc8-d692-467a-9ec1-eab2c6631743 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:07.675347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be321bc8-d692-467a-9ec1-eab2c6631743 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:07.676172 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be321bc8-d692-467a-9ec1-eab2c6631743 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:07.676618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-be321bc8-d692-467a-9ec1-eab2c6631743 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:07.683462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-926f4f4b-9844-44dd-ad8b-69f6f400b19a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:07.684481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-926f4f4b-9844-44dd-ad8b-69f6f400b19a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:07.691118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-926f4f4b-9844-44dd-ad8b-69f6f400b19a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:07.691562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-926f4f4b-9844-44dd-ad8b-69f6f400b19a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:07.692361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-926f4f4b-9844-44dd-ad8b-69f6f400b19a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:07.692797 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-926f4f4b-9844-44dd-ad8b-69f6f400b19a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:07.721430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-926f4f4b-9844-44dd-ad8b-69f6f400b19a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 Jan 15 15:52:07.721987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 292/582] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:07.750552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a68f4d3a-afdf-47a0-a6e3-6700195fb12e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:07.751091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-be321bc8-d692-467a-9ec1-eab2c6631743 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.087976 Jan 15 15:52:07.751471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a68f4d3a-afdf-47a0-a6e3-6700195fb12e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:07.751736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 291/583] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:07 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:07.757813 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a68f4d3a-afdf-47a0-a6e3-6700195fb12e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:07.758269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a68f4d3a-afdf-47a0-a6e3-6700195fb12e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:07.759104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a68f4d3a-afdf-47a0-a6e3-6700195fb12e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:07.759548 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a68f4d3a-afdf-47a0-a6e3-6700195fb12e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:07.816790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a68f4d3a-afdf-47a0-a6e3-6700195fb12e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.069637 Jan 15 15:52:07.817432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 293/584] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:07 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:08.733721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-50d8525c-7b89-4d30-81f3-3c2c5882d9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:08.734730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-50d8525c-7b89-4d30-81f3-3c2c5882d9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:08.741670 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-50d8525c-7b89-4d30-81f3-3c2c5882d9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:08.742128 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-50d8525c-7b89-4d30-81f3-3c2c5882d9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:08.743514 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-50d8525c-7b89-4d30-81f3-3c2c5882d9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:08.744132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-50d8525c-7b89-4d30-81f3-3c2c5882d9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:08.762278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-929ce47a-955b-4b04-af39-7ad404cbb9c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:08.763276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-929ce47a-955b-4b04-af39-7ad404cbb9c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:08.770083 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-929ce47a-955b-4b04-af39-7ad404cbb9c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:08.770534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-929ce47a-955b-4b04-af39-7ad404cbb9c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:08.771314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-929ce47a-955b-4b04-af39-7ad404cbb9c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:08.771753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-929ce47a-955b-4b04-af39-7ad404cbb9c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:08.775411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-50d8525c-7b89-4d30-81f3-3c2c5882d9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Jan 15 15:52:08.775988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 292/585] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:08.828433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7ce888b6-20f3-4158-ad26-c4616aea8309 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:08.829382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7ce888b6-20f3-4158-ad26-c4616aea8309 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:08.835580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce888b6-20f3-4158-ad26-c4616aea8309 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:08.839342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce888b6-20f3-4158-ad26-c4616aea8309 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:08.839342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce888b6-20f3-4158-ad26-c4616aea8309 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:08.839342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce888b6-20f3-4158-ad26-c4616aea8309 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:08.845637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-929ce47a-955b-4b04-af39-7ad404cbb9c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.087260 Jan 15 15:52:08.846510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 294/586] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:08 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:52:08.902153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7ce888b6-20f3-4158-ad26-c4616aea8309 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.077244 Jan 15 15:52:08.902782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 293/587] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:08 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:09.787098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-53989ec5-0d07-48aa-9b96-1d95763a5902 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:09.788154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-53989ec5-0d07-48aa-9b96-1d95763a5902 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:09.796099 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53989ec5-0d07-48aa-9b96-1d95763a5902 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:09.796580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53989ec5-0d07-48aa-9b96-1d95763a5902 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:09.797373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53989ec5-0d07-48aa-9b96-1d95763a5902 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:09.797812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-53989ec5-0d07-48aa-9b96-1d95763a5902 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:09.826655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-53989ec5-0d07-48aa-9b96-1d95763a5902 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043670 Jan 15 15:52:09.827199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 295/588] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:09.859313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7747e5a7-8a63-43ab-a7bc-6501d0d59744 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:09.860707 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7747e5a7-8a63-43ab-a7bc-6501d0d59744 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:09.869333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7747e5a7-8a63-43ab-a7bc-6501d0d59744 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:09.869795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7747e5a7-8a63-43ab-a7bc-6501d0d59744 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:09.870591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7747e5a7-8a63-43ab-a7bc-6501d0d59744 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:09.871048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7747e5a7-8a63-43ab-a7bc-6501d0d59744 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:09.913712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2ff181f9-024c-478c-af05-e5e430be498d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:09.915357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2ff181f9-024c-478c-af05-e5e430be498d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:09.922298 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ff181f9-024c-478c-af05-e5e430be498d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:09.922753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ff181f9-024c-478c-af05-e5e430be498d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:09.923538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ff181f9-024c-478c-af05-e5e430be498d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:09.923981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ff181f9-024c-478c-af05-e5e430be498d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:09.936828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7747e5a7-8a63-43ab-a7bc-6501d0d59744 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.082241 Jan 15 15:52:09.940507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 294/589] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:09 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:09.990203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2ff181f9-024c-478c-af05-e5e430be498d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28165 microversion: 2.1 time: 0.079924 Jan 15 15:52:09.990762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 296/590] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:09 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28165 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:10.838800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0ff4c1d8-2446-4910-af8c-a3a53b68333f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:10.839809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0ff4c1d8-2446-4910-af8c-a3a53b68333f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:10.846695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff4c1d8-2446-4910-af8c-a3a53b68333f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:10.847153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff4c1d8-2446-4910-af8c-a3a53b68333f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:10.847940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff4c1d8-2446-4910-af8c-a3a53b68333f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:10.848411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff4c1d8-2446-4910-af8c-a3a53b68333f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:10.878193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0ff4c1d8-2446-4910-af8c-a3a53b68333f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Jan 15 15:52:10.878783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 295/591] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:10.949152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8bc85aca-f810-46a8-a1e3-f4ac863e64e2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:10.950181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8bc85aca-f810-46a8-a1e3-f4ac863e64e2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:10.957102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bc85aca-f810-46a8-a1e3-f4ac863e64e2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:10.957492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bc85aca-f810-46a8-a1e3-f4ac863e64e2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:10.958263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bc85aca-f810-46a8-a1e3-f4ac863e64e2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:10.958695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8bc85aca-f810-46a8-a1e3-f4ac863e64e2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:11.001803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-946e6c91-caf9-4297-9338-5cd7b892ce31 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:11.002716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-946e6c91-caf9-4297-9338-5cd7b892ce31 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:11.009020 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-946e6c91-caf9-4297-9338-5cd7b892ce31 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:11.009466 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-946e6c91-caf9-4297-9338-5cd7b892ce31 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:11.010234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-946e6c91-caf9-4297-9338-5cd7b892ce31 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:11.010667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-946e6c91-caf9-4297-9338-5cd7b892ce31 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:11.023069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8bc85aca-f810-46a8-a1e3-f4ac863e64e2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.077953 Jan 15 15:52:11.024128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 297/592] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:10 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:11.096328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-946e6c91-caf9-4297-9338-5cd7b892ce31 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28455 microversion: 2.1 time: 0.097927 Jan 15 15:52:11.097198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 296/593] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:10 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:11.890524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f2a32ee1-e8be-46f7-9f0f-b416a41c2a1e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:11.891520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f2a32ee1-e8be-46f7-9f0f-b416a41c2a1e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:11.898360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2a32ee1-e8be-46f7-9f0f-b416a41c2a1e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:11.898849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2a32ee1-e8be-46f7-9f0f-b416a41c2a1e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:11.899879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2a32ee1-e8be-46f7-9f0f-b416a41c2a1e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:11.900360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2a32ee1-e8be-46f7-9f0f-b416a41c2a1e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:11.930767 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f2a32ee1-e8be-46f7-9f0f-b416a41c2a1e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Jan 15 15:52:11.931329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 298/594] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:12.035269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4340c7aa-774e-4e42-8f80-7d30e2214b76 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:12.036318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4340c7aa-774e-4e42-8f80-7d30e2214b76 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:12.043541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4340c7aa-774e-4e42-8f80-7d30e2214b76 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:12.043947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4340c7aa-774e-4e42-8f80-7d30e2214b76 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:12.044780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4340c7aa-774e-4e42-8f80-7d30e2214b76 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:12.045227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4340c7aa-774e-4e42-8f80-7d30e2214b76 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:12.107963 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0500e616-05f0-4abc-bdd8-810a0d92ce0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:12.108904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0500e616-05f0-4abc-bdd8-810a0d92ce0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:12.115134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0500e616-05f0-4abc-bdd8-810a0d92ce0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:12.115583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0500e616-05f0-4abc-bdd8-810a0d92ce0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:12.116399 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0500e616-05f0-4abc-bdd8-810a0d92ce0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:12.116835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0500e616-05f0-4abc-bdd8-810a0d92ce0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:12.120644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4340c7aa-774e-4e42-8f80-7d30e2214b76 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.089230 Jan 15 15:52:12.121561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 297/595] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:12 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:12.201664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0500e616-05f0-4abc-bdd8-810a0d92ce0e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28455 microversion: 2.1 time: 0.097243 Jan 15 15:52:12.202347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 299/596] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:12 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:12.942250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-793a1661-d2a4-4b63-b4c4-80095588a8ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:12.943294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-793a1661-d2a4-4b63-b4c4-80095588a8ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:12.950757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-793a1661-d2a4-4b63-b4c4-80095588a8ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:12.951216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-793a1661-d2a4-4b63-b4c4-80095588a8ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:12.952039 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-793a1661-d2a4-4b63-b4c4-80095588a8ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:12.952506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-793a1661-d2a4-4b63-b4c4-80095588a8ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:12.982028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-793a1661-d2a4-4b63-b4c4-80095588a8ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Jan 15 15:52:12.982579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 298/597] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:13.145326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5cb241b0-a77c-4860-a6a6-20888cc32f7b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:13.145326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5cb241b0-a77c-4860-a6a6-20888cc32f7b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:13.145326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cb241b0-a77c-4860-a6a6-20888cc32f7b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:13.145326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cb241b0-a77c-4860-a6a6-20888cc32f7b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:13.146136 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cb241b0-a77c-4860-a6a6-20888cc32f7b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:13.146136 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cb241b0-a77c-4860-a6a6-20888cc32f7b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:13.213730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0b33c4f9-76a2-4102-b1f5-9f23ecb6cd44 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:13.214279 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5cb241b0-a77c-4860-a6a6-20888cc32f7b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.085277 Jan 15 15:52:13.214654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0b33c4f9-76a2-4102-b1f5-9f23ecb6cd44 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:13.215203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 300/598] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:13 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:13.221210 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0b33c4f9-76a2-4102-b1f5-9f23ecb6cd44 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:13.221666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0b33c4f9-76a2-4102-b1f5-9f23ecb6cd44 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:13.222460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0b33c4f9-76a2-4102-b1f5-9f23ecb6cd44 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:13.222991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0b33c4f9-76a2-4102-b1f5-9f23ecb6cd44 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:13.300337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0b33c4f9-76a2-4102-b1f5-9f23ecb6cd44 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.090768 Jan 15 15:52:13.301006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 299/599] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:13 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:13.994106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7f219c45-f9e3-4955-8402-96f368655d9a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:13.995106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7f219c45-f9e3-4955-8402-96f368655d9a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:14.002186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f219c45-f9e3-4955-8402-96f368655d9a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:14.002640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f219c45-f9e3-4955-8402-96f368655d9a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:14.003421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f219c45-f9e3-4955-8402-96f368655d9a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:14.003876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7f219c45-f9e3-4955-8402-96f368655d9a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:14.032790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7f219c45-f9e3-4955-8402-96f368655d9a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Jan 15 15:52:14.033352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 301/600] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:14.226552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-06755685-a37c-471e-b66a-a89476b55760 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:14.228579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-06755685-a37c-471e-b66a-a89476b55760 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:14.235406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06755685-a37c-471e-b66a-a89476b55760 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:14.235851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06755685-a37c-471e-b66a-a89476b55760 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:14.236658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06755685-a37c-471e-b66a-a89476b55760 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:14.237095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-06755685-a37c-471e-b66a-a89476b55760 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:14.299632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-06755685-a37c-471e-b66a-a89476b55760 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.077028 Jan 15 15:52:14.300276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 300/601] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:14 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:14.312152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d25fe226-9490-4bda-a16b-5706dc5fb75c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:14.313070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d25fe226-9490-4bda-a16b-5706dc5fb75c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:14.319323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25fe226-9490-4bda-a16b-5706dc5fb75c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:14.319771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25fe226-9490-4bda-a16b-5706dc5fb75c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:14.320577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25fe226-9490-4bda-a16b-5706dc5fb75c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:14.321017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25fe226-9490-4bda-a16b-5706dc5fb75c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:14.381541 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d25fe226-9490-4bda-a16b-5706dc5fb75c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.072918 Jan 15 15:52:14.382247 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 302/602] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:14 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:15.044542 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-74e1d956-c1e1-410b-a37e-2a773cced6b9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:15.045546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-74e1d956-c1e1-410b-a37e-2a773cced6b9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:15.052458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74e1d956-c1e1-410b-a37e-2a773cced6b9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:15.052916 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74e1d956-c1e1-410b-a37e-2a773cced6b9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:15.053694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74e1d956-c1e1-410b-a37e-2a773cced6b9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:15.054131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74e1d956-c1e1-410b-a37e-2a773cced6b9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:15.083591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-74e1d956-c1e1-410b-a37e-2a773cced6b9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Jan 15 15:52:15.084163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 301/603] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:15.312476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-94e4542e-7c5d-4fe2-8c22-e5ed20d45295 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:15.313387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-94e4542e-7c5d-4fe2-8c22-e5ed20d45295 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:15.320108 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94e4542e-7c5d-4fe2-8c22-e5ed20d45295 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:15.320633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94e4542e-7c5d-4fe2-8c22-e5ed20d45295 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:15.321401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94e4542e-7c5d-4fe2-8c22-e5ed20d45295 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:15.321828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94e4542e-7c5d-4fe2-8c22-e5ed20d45295 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:15.388723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-94e4542e-7c5d-4fe2-8c22-e5ed20d45295 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 28628 microversion: 2.20 time: 0.080227 Jan 15 15:52:15.389546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 303/604] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:15 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 28628 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:15.393434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-206d53ee-9771-4717-8927-6c40aacdd26e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:15.394343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-206d53ee-9771-4717-8927-6c40aacdd26e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:15.400953 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-206d53ee-9771-4717-8927-6c40aacdd26e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:15.401402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-206d53ee-9771-4717-8927-6c40aacdd26e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:15.402179 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-206d53ee-9771-4717-8927-6c40aacdd26e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:15.402612 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-206d53ee-9771-4717-8927-6c40aacdd26e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:15.474491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-206d53ee-9771-4717-8927-6c40aacdd26e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.084541 Jan 15 15:52:15.475140 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 302/605] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:15 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:16.095268 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0a383edf-8341-4ff2-8c14-a652c2800938 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:16.096341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0a383edf-8341-4ff2-8c14-a652c2800938 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:16.103441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a383edf-8341-4ff2-8c14-a652c2800938 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:16.103888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a383edf-8341-4ff2-8c14-a652c2800938 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:16.104682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a383edf-8341-4ff2-8c14-a652c2800938 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:16.105115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a383edf-8341-4ff2-8c14-a652c2800938 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:16.134958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0a383edf-8341-4ff2-8c14-a652c2800938 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Jan 15 15:52:16.135506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 304/606] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:16.401716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8225a0c7-eab5-41b8-bfaf-90821f5ea4e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:16.402744 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8225a0c7-eab5-41b8-bfaf-90821f5ea4e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:16.409540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8225a0c7-eab5-41b8-bfaf-90821f5ea4e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:16.409989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8225a0c7-eab5-41b8-bfaf-90821f5ea4e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:16.410872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8225a0c7-eab5-41b8-bfaf-90821f5ea4e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:16.411311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8225a0c7-eab5-41b8-bfaf-90821f5ea4e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:16.486234 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b8cf3837-db79-4bdc-852a-a53ed3a1de1f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:16.487695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b8cf3837-db79-4bdc-852a-a53ed3a1de1f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:16.489608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8225a0c7-eab5-41b8-bfaf-90821f5ea4e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 29091 microversion: 2.20 time: 0.092123 Jan 15 15:52:16.491074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 303/607] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:16 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 29091 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:16.494548 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8cf3837-db79-4bdc-852a-a53ed3a1de1f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:16.495001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8cf3837-db79-4bdc-852a-a53ed3a1de1f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:16.495789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8cf3837-db79-4bdc-852a-a53ed3a1de1f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:16.496258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8cf3837-db79-4bdc-852a-a53ed3a1de1f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:16.557614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b8cf3837-db79-4bdc-852a-a53ed3a1de1f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.074835 Jan 15 15:52:16.558237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 305/608] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:16 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:17.146747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f98ee55a-4e91-4d48-b718-95a1eb1c6ff1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:17.147754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f98ee55a-4e91-4d48-b718-95a1eb1c6ff1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:17.155063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f98ee55a-4e91-4d48-b718-95a1eb1c6ff1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:17.155515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f98ee55a-4e91-4d48-b718-95a1eb1c6ff1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:17.156342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f98ee55a-4e91-4d48-b718-95a1eb1c6ff1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:17.156789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f98ee55a-4e91-4d48-b718-95a1eb1c6ff1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:17.186321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f98ee55a-4e91-4d48-b718-95a1eb1c6ff1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Jan 15 15:52:17.186869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 304/609] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:17.502094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a804b439-2cff-43a1-8a3f-820597f83024 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:17.503121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a804b439-2cff-43a1-8a3f-820597f83024 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:17.510697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a804b439-2cff-43a1-8a3f-820597f83024 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:17.511195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a804b439-2cff-43a1-8a3f-820597f83024 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:17.512350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a804b439-2cff-43a1-8a3f-820597f83024 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:17.512807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a804b439-2cff-43a1-8a3f-820597f83024 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:17.569111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8f07c9fe-c197-4709-877b-81275973a1a6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:17.570042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8f07c9fe-c197-4709-877b-81275973a1a6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:17.577055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f07c9fe-c197-4709-877b-81275973a1a6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:17.577521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f07c9fe-c197-4709-877b-81275973a1a6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:17.578305 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f07c9fe-c197-4709-877b-81275973a1a6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:17.578755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f07c9fe-c197-4709-877b-81275973a1a6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:17.591821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a804b439-2cff-43a1-8a3f-820597f83024 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 30881 microversion: 2.20 time: 0.093696 Jan 15 15:52:17.595828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 306/610] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:17 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 30881 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:17.645441 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8f07c9fe-c197-4709-877b-81275973a1a6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.079894 Jan 15 15:52:17.647049 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 305/611] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:17 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:18.198145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5cbd3013-85de-4459-8270-306987a3c57f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:18.199137 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5cbd3013-85de-4459-8270-306987a3c57f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:18.205968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cbd3013-85de-4459-8270-306987a3c57f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:18.206416 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cbd3013-85de-4459-8270-306987a3c57f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:18.207195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cbd3013-85de-4459-8270-306987a3c57f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:18.207626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5cbd3013-85de-4459-8270-306987a3c57f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:18.237485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5cbd3013-85de-4459-8270-306987a3c57f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043473 Jan 15 15:52:18.238045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 307/612] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:18.604389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-072a297f-2d16-49d7-b679-f01036402417 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:18.605406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-072a297f-2d16-49d7-b679-f01036402417 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:18.612377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-072a297f-2d16-49d7-b679-f01036402417 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:18.612840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-072a297f-2d16-49d7-b679-f01036402417 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:18.613636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-072a297f-2d16-49d7-b679-f01036402417 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:18.614079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-072a297f-2d16-49d7-b679-f01036402417 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:18.657192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0fafd4ec-fc2f-4f47-9819-7b41ca861f99 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:18.658108 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0fafd4ec-fc2f-4f47-9819-7b41ca861f99 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:18.665438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fafd4ec-fc2f-4f47-9819-7b41ca861f99 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:18.665888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fafd4ec-fc2f-4f47-9819-7b41ca861f99 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:18.666998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fafd4ec-fc2f-4f47-9819-7b41ca861f99 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:18.667462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fafd4ec-fc2f-4f47-9819-7b41ca861f99 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:18.700610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-072a297f-2d16-49d7-b679-f01036402417 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 32117 microversion: 2.20 time: 0.100810 Jan 15 15:52:18.701268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 306/613] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:18 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 32117 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:18.735014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0fafd4ec-fc2f-4f47-9819-7b41ca861f99 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.081241 Jan 15 15:52:18.735651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 308/614] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:18 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:19.249194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-76a61095-33e3-4fb7-8f09-9be078c98993 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:19.250189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-76a61095-33e3-4fb7-8f09-9be078c98993 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:19.256983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76a61095-33e3-4fb7-8f09-9be078c98993 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:19.257433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76a61095-33e3-4fb7-8f09-9be078c98993 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:19.258206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76a61095-33e3-4fb7-8f09-9be078c98993 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:19.258639 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76a61095-33e3-4fb7-8f09-9be078c98993 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:19.289154 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-76a61095-33e3-4fb7-8f09-9be078c98993 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Jan 15 15:52:19.289699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 307/615] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:19.713440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ef936789-5084-40a3-b6ff-f16f9e1953e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:19.714473 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ef936789-5084-40a3-b6ff-f16f9e1953e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:19.721352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef936789-5084-40a3-b6ff-f16f9e1953e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:19.721801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef936789-5084-40a3-b6ff-f16f9e1953e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:19.722579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef936789-5084-40a3-b6ff-f16f9e1953e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:19.723016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef936789-5084-40a3-b6ff-f16f9e1953e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:19.746274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e7c21211-488a-4941-a589-d34861fdc2c2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:19.747180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e7c21211-488a-4941-a589-d34861fdc2c2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:19.753354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7c21211-488a-4941-a589-d34861fdc2c2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:19.753804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7c21211-488a-4941-a589-d34861fdc2c2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:19.754577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7c21211-488a-4941-a589-d34861fdc2c2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:19.755011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7c21211-488a-4941-a589-d34861fdc2c2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:19.805409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ef936789-5084-40a3-b6ff-f16f9e1953e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 33253 microversion: 2.20 time: 0.096606 Jan 15 15:52:19.806355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 309/616] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:19 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 33253 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:19.835790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e7c21211-488a-4941-a589-d34861fdc2c2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.093253 Jan 15 15:52:19.836456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 308/617] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:19 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:20.300766 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-22342df5-fc32-4bf1-b9eb-76a0eb0b4aa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:20.301760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-22342df5-fc32-4bf1-b9eb-76a0eb0b4aa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:20.309245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22342df5-fc32-4bf1-b9eb-76a0eb0b4aa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:20.309701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22342df5-fc32-4bf1-b9eb-76a0eb0b4aa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:20.310479 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22342df5-fc32-4bf1-b9eb-76a0eb0b4aa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:20.310914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22342df5-fc32-4bf1-b9eb-76a0eb0b4aa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:20.340934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-22342df5-fc32-4bf1-b9eb-76a0eb0b4aa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Jan 15 15:52:20.341492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 310/618] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:20.817869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a792decb-c147-4e52-aa4a-7c7447663c0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:20.818871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a792decb-c147-4e52-aa4a-7c7447663c0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:20.825929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a792decb-c147-4e52-aa4a-7c7447663c0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:20.826373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a792decb-c147-4e52-aa4a-7c7447663c0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:20.827143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a792decb-c147-4e52-aa4a-7c7447663c0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:20.827579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a792decb-c147-4e52-aa4a-7c7447663c0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:20.846623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-93ec47fd-803e-44e6-aa35-5086625f9f57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:20.848923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-93ec47fd-803e-44e6-aa35-5086625f9f57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:20.855490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93ec47fd-803e-44e6-aa35-5086625f9f57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:20.855949 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93ec47fd-803e-44e6-aa35-5086625f9f57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:20.856829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93ec47fd-803e-44e6-aa35-5086625f9f57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:20.857326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93ec47fd-803e-44e6-aa35-5086625f9f57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:20.952651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a792decb-c147-4e52-aa4a-7c7447663c0a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 34302 microversion: 2.20 time: 0.138640 Jan 15 15:52:20.953295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 309/619] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:20 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 34302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:20.971620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-93ec47fd-803e-44e6-aa35-5086625f9f57 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.128529 Jan 15 15:52:20.972288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 311/620] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:20 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:21.353190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-61d4793f-046f-4ee1-b16d-01240e895a2c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:21.360119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-61d4793f-046f-4ee1-b16d-01240e895a2c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:21.361207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61d4793f-046f-4ee1-b16d-01240e895a2c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:21.361661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61d4793f-046f-4ee1-b16d-01240e895a2c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:21.362447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61d4793f-046f-4ee1-b16d-01240e895a2c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:21.362882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61d4793f-046f-4ee1-b16d-01240e895a2c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:21.392536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-61d4793f-046f-4ee1-b16d-01240e895a2c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Jan 15 15:52:21.393090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 310/621] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:21.965227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f4846a8f-f9f1-471f-bb42-24fa6146e7f9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:21.966222 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f4846a8f-f9f1-471f-bb42-24fa6146e7f9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:21.973218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4846a8f-f9f1-471f-bb42-24fa6146e7f9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:21.973670 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4846a8f-f9f1-471f-bb42-24fa6146e7f9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:21.974442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4846a8f-f9f1-471f-bb42-24fa6146e7f9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:21.974889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4846a8f-f9f1-471f-bb42-24fa6146e7f9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:21.983317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b4139b89-f048-43df-866f-4a0cb705a972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:21.984420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b4139b89-f048-43df-866f-4a0cb705a972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:21.990694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4139b89-f048-43df-866f-4a0cb705a972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:21.991218 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4139b89-f048-43df-866f-4a0cb705a972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:21.992067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4139b89-f048-43df-866f-4a0cb705a972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:21.992533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4139b89-f048-43df-866f-4a0cb705a972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:22.065401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f4846a8f-f9f1-471f-bb42-24fa6146e7f9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 35654 microversion: 2.20 time: 0.104601 Jan 15 15:52:22.066296 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 312/622] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:21 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 35654 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:22.074799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b4139b89-f048-43df-866f-4a0cb705a972 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.094921 Jan 15 15:52:22.075440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 311/623] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:21 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:22.404304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c9f62f7a-6570-4c1e-84c0-3ffdcdba336b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:22.405304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c9f62f7a-6570-4c1e-84c0-3ffdcdba336b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:22.412169 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9f62f7a-6570-4c1e-84c0-3ffdcdba336b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:22.412645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9f62f7a-6570-4c1e-84c0-3ffdcdba336b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:22.413419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9f62f7a-6570-4c1e-84c0-3ffdcdba336b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:22.413859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c9f62f7a-6570-4c1e-84c0-3ffdcdba336b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:22.447239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c9f62f7a-6570-4c1e-84c0-3ffdcdba336b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Jan 15 15:52:22.447819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 313/624] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:23.077820 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-710f9eec-8caa-4a91-9059-34c8c03d252d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:23.078814 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-710f9eec-8caa-4a91-9059-34c8c03d252d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:23.085622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-710f9eec-8caa-4a91-9059-34c8c03d252d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:23.086022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-20f5ebd4-1d6c-4bfa-809e-a1aa966bbe4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:23.086450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-710f9eec-8caa-4a91-9059-34c8c03d252d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:23.086832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-710f9eec-8caa-4a91-9059-34c8c03d252d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:23.087481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-20f5ebd4-1d6c-4bfa-809e-a1aa966bbe4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:23.087940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-710f9eec-8caa-4a91-9059-34c8c03d252d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:23.093856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20f5ebd4-1d6c-4bfa-809e-a1aa966bbe4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:23.094302 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20f5ebd4-1d6c-4bfa-809e-a1aa966bbe4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:23.095084 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20f5ebd4-1d6c-4bfa-809e-a1aa966bbe4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:23.095522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20f5ebd4-1d6c-4bfa-809e-a1aa966bbe4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:23.162814 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-710f9eec-8caa-4a91-9059-34c8c03d252d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 37167 microversion: 2.20 time: 0.088805 Jan 15 15:52:23.163749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 312/625] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:23 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 37167 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:23.182460 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-20f5ebd4-1d6c-4bfa-809e-a1aa966bbe4f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.099875 Jan 15 15:52:23.183103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 314/626] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:23 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:23.459233 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-82dc489e-9502-46b5-88a5-f9317cdf9ff7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:23.460273 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-82dc489e-9502-46b5-88a5-f9317cdf9ff7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:23.467994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-82dc489e-9502-46b5-88a5-f9317cdf9ff7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:23.468484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-82dc489e-9502-46b5-88a5-f9317cdf9ff7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:23.469270 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-82dc489e-9502-46b5-88a5-f9317cdf9ff7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:23.469710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-82dc489e-9502-46b5-88a5-f9317cdf9ff7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:23.504634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-82dc489e-9502-46b5-88a5-f9317cdf9ff7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049459 Jan 15 15:52:23.505296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 313/627] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:24.175816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d837018a-6395-44a0-9444-56b711b1f70d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:24.176836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d837018a-6395-44a0-9444-56b711b1f70d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:24.184056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d837018a-6395-44a0-9444-56b711b1f70d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:24.184587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d837018a-6395-44a0-9444-56b711b1f70d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:24.185379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d837018a-6395-44a0-9444-56b711b1f70d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:24.185819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d837018a-6395-44a0-9444-56b711b1f70d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:24.193869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cbed6666-77f6-4e9c-b3ba-812a29db130c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:24.194864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cbed6666-77f6-4e9c-b3ba-812a29db130c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:24.202125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbed6666-77f6-4e9c-b3ba-812a29db130c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:24.202677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbed6666-77f6-4e9c-b3ba-812a29db130c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:24.203538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbed6666-77f6-4e9c-b3ba-812a29db130c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:24.204043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbed6666-77f6-4e9c-b3ba-812a29db130c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:24.260703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d837018a-6395-44a0-9444-56b711b1f70d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 38184 microversion: 2.20 time: 0.088558 Jan 15 15:52:24.261353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 315/628] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:24 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 38184 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:24.271905 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cbed6666-77f6-4e9c-b3ba-812a29db130c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.081538 Jan 15 15:52:24.272769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 314/629] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:24 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:24.517072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f8dbab00-34cf-49e6-bbe0-1cc9bdc42822 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:24.518069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f8dbab00-34cf-49e6-bbe0-1cc9bdc42822 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:24.525583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8dbab00-34cf-49e6-bbe0-1cc9bdc42822 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:24.526032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8dbab00-34cf-49e6-bbe0-1cc9bdc42822 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:24.526801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8dbab00-34cf-49e6-bbe0-1cc9bdc42822 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:24.533235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8dbab00-34cf-49e6-bbe0-1cc9bdc42822 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:24.564683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f8dbab00-34cf-49e6-bbe0-1cc9bdc42822 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051794 Jan 15 15:52:24.565240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 316/630] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:25.273146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-61f74617-207a-41e0-8b48-1596b988335f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:25.274225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-61f74617-207a-41e0-8b48-1596b988335f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:25.281981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61f74617-207a-41e0-8b48-1596b988335f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:25.282464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61f74617-207a-41e0-8b48-1596b988335f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:25.283258 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61f74617-207a-41e0-8b48-1596b988335f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:25.283701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61f74617-207a-41e0-8b48-1596b988335f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:25.284009 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-84979267-bb0e-4c54-aa7b-08602826e450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:25.284954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-84979267-bb0e-4c54-aa7b-08602826e450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:25.291221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84979267-bb0e-4c54-aa7b-08602826e450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:25.291922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84979267-bb0e-4c54-aa7b-08602826e450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:25.292720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84979267-bb0e-4c54-aa7b-08602826e450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:25.293344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84979267-bb0e-4c54-aa7b-08602826e450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:25.347701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-61f74617-207a-41e0-8b48-1596b988335f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 38184 microversion: 2.20 time: 0.078520 Jan 15 15:52:25.348663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 315/631] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:25 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 38184 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:52:25.356203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-84979267-bb0e-4c54-aa7b-08602826e450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.075743 Jan 15 15:52:25.356844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 317/632] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:25 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:25.576940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3bad8de0-5620-4f5d-8974-3abdbae95972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:25.577869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3bad8de0-5620-4f5d-8974-3abdbae95972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:25.584720 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bad8de0-5620-4f5d-8974-3abdbae95972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:25.585168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bad8de0-5620-4f5d-8974-3abdbae95972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:25.585941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bad8de0-5620-4f5d-8974-3abdbae95972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:25.586375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bad8de0-5620-4f5d-8974-3abdbae95972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:25.614318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3bad8de0-5620-4f5d-8974-3abdbae95972 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Jan 15 15:52:25.614855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 316/633] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:26.360366 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-635a62d6-a30f-4bab-882c-61b75726d994 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:26.362239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-635a62d6-a30f-4bab-882c-61b75726d994 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:26.366741 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-40c63db7-51e5-4c75-9fc3-b1fdebbf7a4b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:26.368464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-40c63db7-51e5-4c75-9fc3-b1fdebbf7a4b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:26.368682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-635a62d6-a30f-4bab-882c-61b75726d994 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:26.369343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-635a62d6-a30f-4bab-882c-61b75726d994 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:26.370141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-635a62d6-a30f-4bab-882c-61b75726d994 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:26.370581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-635a62d6-a30f-4bab-882c-61b75726d994 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:26.374863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40c63db7-51e5-4c75-9fc3-b1fdebbf7a4b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:26.375323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40c63db7-51e5-4c75-9fc3-b1fdebbf7a4b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:26.376123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40c63db7-51e5-4c75-9fc3-b1fdebbf7a4b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:26.376598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40c63db7-51e5-4c75-9fc3-b1fdebbf7a4b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:26.435604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-635a62d6-a30f-4bab-882c-61b75726d994 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 38184 microversion: 2.20 time: 0.079236 Jan 15 15:52:26.436286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 318/634] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:26 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 38184 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:26.442720 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-40c63db7-51e5-4c75-9fc3-b1fdebbf7a4b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.079502 Jan 15 15:52:26.443365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 317/635] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:26 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:26.626520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f71aa881-d5a3-4c2e-ac21-3f8944b5d54e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:26.627568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f71aa881-d5a3-4c2e-ac21-3f8944b5d54e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:26.635675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f71aa881-d5a3-4c2e-ac21-3f8944b5d54e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:26.636289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f71aa881-d5a3-4c2e-ac21-3f8944b5d54e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:26.637075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f71aa881-d5a3-4c2e-ac21-3f8944b5d54e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:26.637507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f71aa881-d5a3-4c2e-ac21-3f8944b5d54e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:26.668229 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f71aa881-d5a3-4c2e-ac21-3f8944b5d54e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Jan 15 15:52:26.668803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 319/636] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:27.447746 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-22003140-869b-4032-9fc8-99c857612c93 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:27.448713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-22003140-869b-4032-9fc8-99c857612c93 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:27.454572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-13c74f69-ae16-4f28-b736-209ea591d506 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:27.455473 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-13c74f69-ae16-4f28-b736-209ea591d506 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:27.455611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22003140-869b-4032-9fc8-99c857612c93 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:27.455968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22003140-869b-4032-9fc8-99c857612c93 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:27.456778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22003140-869b-4032-9fc8-99c857612c93 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:27.457217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22003140-869b-4032-9fc8-99c857612c93 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:27.462386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13c74f69-ae16-4f28-b736-209ea591d506 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:27.462843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13c74f69-ae16-4f28-b736-209ea591d506 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:27.463641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13c74f69-ae16-4f28-b736-209ea591d506 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:27.464128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13c74f69-ae16-4f28-b736-209ea591d506 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:27.523939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-22003140-869b-4032-9fc8-99c857612c93 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 38184 microversion: 2.20 time: 0.080630 Jan 15 15:52:27.525452 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 318/637] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:27 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 38184 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:27.530954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-13c74f69-ae16-4f28-b736-209ea591d506 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.079886 Jan 15 15:52:27.531638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 320/638] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:27 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:27.679301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-68272a29-70be-4bff-aec2-f2ba9ad8cbb1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:27.680371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-68272a29-70be-4bff-aec2-f2ba9ad8cbb1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:27.687579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68272a29-70be-4bff-aec2-f2ba9ad8cbb1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:27.688033 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68272a29-70be-4bff-aec2-f2ba9ad8cbb1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:27.688856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68272a29-70be-4bff-aec2-f2ba9ad8cbb1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:27.689319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68272a29-70be-4bff-aec2-f2ba9ad8cbb1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:27.719388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-68272a29-70be-4bff-aec2-f2ba9ad8cbb1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Jan 15 15:52:27.719871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 319/639] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:28.536895 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-50e1c26f-9734-44d4-b9e9-98601d4d3183 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:28.537893 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-50e1c26f-9734-44d4-b9e9-98601d4d3183 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:28.543856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5f0325d6-9c43-4714-be82-74c187bcbf0c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:28.545394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50e1c26f-9734-44d4-b9e9-98601d4d3183 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.545849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50e1c26f-9734-44d4-b9e9-98601d4d3183 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.546409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5f0325d6-9c43-4714-be82-74c187bcbf0c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:28.546649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50e1c26f-9734-44d4-b9e9-98601d4d3183 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.547087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-50e1c26f-9734-44d4-b9e9-98601d4d3183 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.553045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f0325d6-9c43-4714-be82-74c187bcbf0c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.553545 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f0325d6-9c43-4714-be82-74c187bcbf0c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.554330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f0325d6-9c43-4714-be82-74c187bcbf0c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.554765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f0325d6-9c43-4714-be82-74c187bcbf0c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.623571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-50e1c26f-9734-44d4-b9e9-98601d4d3183 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action" status: 200 len: 38327 microversion: 2.20 time: 0.090339 Jan 15 15:52:28.624251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 321/640] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:52:28 2022] POST /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/action => generated 38327 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:52:28.627224 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5f0325d6-9c43-4714-be82-74c187bcbf0c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.088283 Jan 15 15:52:28.628011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 320/641] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:28 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:28.635170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-36ec40a3-f646-42a1-b001-479b9418e04d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:28.635755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-36ec40a3-f646-42a1-b001-479b9418e04d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:28.642684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36ec40a3-f646-42a1-b001-479b9418e04d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.643138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36ec40a3-f646-42a1-b001-479b9418e04d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.643919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36ec40a3-f646-42a1-b001-479b9418e04d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.644395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36ec40a3-f646-42a1-b001-479b9418e04d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.668220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-36ec40a3-f646-42a1-b001-479b9418e04d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/ips" status: 200 len: 151 microversion: 2.20 time: 0.037636 Jan 15 15:52:28.668786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 322/642] 10.222.0.36 () {60 vars in 1288 bytes} [Sat Jan 15 15:52:28 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:28.731303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-738e7ea6-7078-4ac0-a1fa-89395e04ef1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:28.732440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-738e7ea6-7078-4ac0-a1fa-89395e04ef1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:28.739243 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-738e7ea6-7078-4ac0-a1fa-89395e04ef1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.739702 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-738e7ea6-7078-4ac0-a1fa-89395e04ef1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.740516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-738e7ea6-7078-4ac0-a1fa-89395e04ef1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:28.740956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-738e7ea6-7078-4ac0-a1fa-89395e04ef1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:28.772505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-738e7ea6-7078-4ac0-a1fa-89395e04ef1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Jan 15 15:52:28.773001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 321/643] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:29.639267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1f744d81-b3ee-4e3c-9466-b4a282bd54f4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:29.640232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1f744d81-b3ee-4e3c-9466-b4a282bd54f4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:29.646390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f744d81-b3ee-4e3c-9466-b4a282bd54f4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:29.646838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f744d81-b3ee-4e3c-9466-b4a282bd54f4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:29.647607 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f744d81-b3ee-4e3c-9466-b4a282bd54f4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:29.648040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f744d81-b3ee-4e3c-9466-b4a282bd54f4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:29.717353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1f744d81-b3ee-4e3c-9466-b4a282bd54f4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.081597 Jan 15 15:52:29.717995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 323/644] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:29 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:29.783699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fed6721f-702e-4ac2-8c23-0d5c0c5bae08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:29.784656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fed6721f-702e-4ac2-8c23-0d5c0c5bae08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:29.791409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fed6721f-702e-4ac2-8c23-0d5c0c5bae08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:29.791863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fed6721f-702e-4ac2-8c23-0d5c0c5bae08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:29.792662 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fed6721f-702e-4ac2-8c23-0d5c0c5bae08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:29.793100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fed6721f-702e-4ac2-8c23-0d5c0c5bae08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:29.822332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fed6721f-702e-4ac2-8c23-0d5c0c5bae08 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Jan 15 15:52:29.822807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 322/645] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:30.729141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-284061b3-e908-40ef-b6d9-90e347874243 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:30.730144 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-284061b3-e908-40ef-b6d9-90e347874243 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:30.738944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284061b3-e908-40ef-b6d9-90e347874243 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:30.739754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284061b3-e908-40ef-b6d9-90e347874243 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:30.741201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284061b3-e908-40ef-b6d9-90e347874243 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:30.741905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-284061b3-e908-40ef-b6d9-90e347874243 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:30.805280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-284061b3-e908-40ef-b6d9-90e347874243 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.079963 Jan 15 15:52:30.806399 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 324/646] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:30 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:30.833394 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b5994fc9-1292-4384-bdc6-1c6d9084162e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:30.834299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b5994fc9-1292-4384-bdc6-1c6d9084162e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:30.840933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5994fc9-1292-4384-bdc6-1c6d9084162e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:30.841382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5994fc9-1292-4384-bdc6-1c6d9084162e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:30.842156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5994fc9-1292-4384-bdc6-1c6d9084162e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:30.842589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5994fc9-1292-4384-bdc6-1c6d9084162e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:30.871682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b5994fc9-1292-4384-bdc6-1c6d9084162e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Jan 15 15:52:30.872177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 323/647] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:31.817120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8ff72e2f-c070-4d70-a824-5240ffa43c6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:31.818120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ff72e2f-c070-4d70-a824-5240ffa43c6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:31.825541 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ff72e2f-c070-4d70-a824-5240ffa43c6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:31.825990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ff72e2f-c070-4d70-a824-5240ffa43c6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:31.826768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ff72e2f-c070-4d70-a824-5240ffa43c6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:31.827206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ff72e2f-c070-4d70-a824-5240ffa43c6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:31.882655 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-df547feb-c680-4720-808b-e01c2469dd5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:31.883565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-df547feb-c680-4720-808b-e01c2469dd5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:31.888294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8ff72e2f-c070-4d70-a824-5240ffa43c6b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.075087 Jan 15 15:52:31.889770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 325/648] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:31 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:31.890727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df547feb-c680-4720-808b-e01c2469dd5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:31.891189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df547feb-c680-4720-808b-e01c2469dd5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:31.891977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df547feb-c680-4720-808b-e01c2469dd5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:31.892448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df547feb-c680-4720-808b-e01c2469dd5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:31.922609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-df547feb-c680-4720-808b-e01c2469dd5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Jan 15 15:52:31.923081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 324/649] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:32.900405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f6abce8f-db37-48fe-aee8-c20c373b421a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:32.902133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f6abce8f-db37-48fe-aee8-c20c373b421a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:32.908915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6abce8f-db37-48fe-aee8-c20c373b421a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:32.909356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6abce8f-db37-48fe-aee8-c20c373b421a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:32.910127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6abce8f-db37-48fe-aee8-c20c373b421a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:32.910559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6abce8f-db37-48fe-aee8-c20c373b421a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:32.934432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d37b440f-a1aa-42a1-ae47-eddbf4fdcfa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:32.935351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d37b440f-a1aa-42a1-ae47-eddbf4fdcfa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:32.941732 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d37b440f-a1aa-42a1-ae47-eddbf4fdcfa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:32.942186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d37b440f-a1aa-42a1-ae47-eddbf4fdcfa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:32.942999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d37b440f-a1aa-42a1-ae47-eddbf4fdcfa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:32.943440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d37b440f-a1aa-42a1-ae47-eddbf4fdcfa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:32.971894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d37b440f-a1aa-42a1-ae47-eddbf4fdcfa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Jan 15 15:52:32.972067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f6abce8f-db37-48fe-aee8-c20c373b421a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.075401 Jan 15 15:52:32.972410 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 325/650] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:32.972543 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 326/651] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:32 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:33.983844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-23b5cfa2-12f8-4433-b32a-2361eca9dc17 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:33.984788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-23b5cfa2-12f8-4433-b32a-2361eca9dc17 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:33.986153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-544897b0-0b73-4ea4-b366-187c28bb0c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:33.987153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-544897b0-0b73-4ea4-b366-187c28bb0c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:33.990712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23b5cfa2-12f8-4433-b32a-2361eca9dc17 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:33.991165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23b5cfa2-12f8-4433-b32a-2361eca9dc17 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:33.991956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23b5cfa2-12f8-4433-b32a-2361eca9dc17 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:33.992433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23b5cfa2-12f8-4433-b32a-2361eca9dc17 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:33.993870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-544897b0-0b73-4ea4-b366-187c28bb0c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:33.994316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-544897b0-0b73-4ea4-b366-187c28bb0c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:33.995837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-544897b0-0b73-4ea4-b366-187c28bb0c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:33.996370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-544897b0-0b73-4ea4-b366-187c28bb0c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:34.029028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-544897b0-0b73-4ea4-b366-187c28bb0c5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049646 Jan 15 15:52:34.029807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 327/652] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:34.079784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-23b5cfa2-12f8-4433-b32a-2361eca9dc17 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.100447 Jan 15 15:52:34.080462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 326/653] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:33 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:35.039468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8d8ee7f9-0fa4-4606-8b90-376b17526ec5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:35.040433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8d8ee7f9-0fa4-4606-8b90-376b17526ec5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:35.047694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8d8ee7f9-0fa4-4606-8b90-376b17526ec5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:35.048162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8d8ee7f9-0fa4-4606-8b90-376b17526ec5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:35.048948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8d8ee7f9-0fa4-4606-8b90-376b17526ec5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:35.049383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8d8ee7f9-0fa4-4606-8b90-376b17526ec5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:35.078838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8d8ee7f9-0fa4-4606-8b90-376b17526ec5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Jan 15 15:52:35.079382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 328/654] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:35.092457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4c40c32c-5166-40ac-ab1a-c3fb47621959 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:35.093484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4c40c32c-5166-40ac-ab1a-c3fb47621959 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:35.100294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c40c32c-5166-40ac-ab1a-c3fb47621959 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:35.100798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c40c32c-5166-40ac-ab1a-c3fb47621959 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:35.101585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c40c32c-5166-40ac-ab1a-c3fb47621959 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:35.102021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c40c32c-5166-40ac-ab1a-c3fb47621959 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:35.176685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4c40c32c-5166-40ac-ab1a-c3fb47621959 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.088872 Jan 15 15:52:35.177311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 327/655] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:35 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:36.089859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7448b62f-356d-4c3c-acaf-628b0dba7967 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:36.090797 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7448b62f-356d-4c3c-acaf-628b0dba7967 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:36.097200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7448b62f-356d-4c3c-acaf-628b0dba7967 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:36.097654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7448b62f-356d-4c3c-acaf-628b0dba7967 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:36.098433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7448b62f-356d-4c3c-acaf-628b0dba7967 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:36.098898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7448b62f-356d-4c3c-acaf-628b0dba7967 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:36.128041 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7448b62f-356d-4c3c-acaf-628b0dba7967 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 Jan 15 15:52:36.128634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 329/656] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:36.188900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-18a1c74b-7af3-411d-adba-2db92f7a7c39 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:36.189939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-18a1c74b-7af3-411d-adba-2db92f7a7c39 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:36.196825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a1c74b-7af3-411d-adba-2db92f7a7c39 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:36.197280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a1c74b-7af3-411d-adba-2db92f7a7c39 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:36.198065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a1c74b-7af3-411d-adba-2db92f7a7c39 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:36.198501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a1c74b-7af3-411d-adba-2db92f7a7c39 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:36.273306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-18a1c74b-7af3-411d-adba-2db92f7a7c39 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.088358 Jan 15 15:52:36.273910 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 328/657] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:36 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:52:37.139990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e4c70786-a19e-4ef1-95bd-94ab15f405e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:37.140938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e4c70786-a19e-4ef1-95bd-94ab15f405e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:37.147125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e4c70786-a19e-4ef1-95bd-94ab15f405e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:37.147572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e4c70786-a19e-4ef1-95bd-94ab15f405e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:37.148546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e4c70786-a19e-4ef1-95bd-94ab15f405e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:37.148985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e4c70786-a19e-4ef1-95bd-94ab15f405e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:37.178494 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e4c70786-a19e-4ef1-95bd-94ab15f405e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Jan 15 15:52:37.179052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 330/658] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:37.285141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e9d4ee35-1076-4d97-8660-d81d858c0a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:37.286151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e9d4ee35-1076-4d97-8660-d81d858c0a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:37.293607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e9d4ee35-1076-4d97-8660-d81d858c0a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:37.294064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e9d4ee35-1076-4d97-8660-d81d858c0a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:37.294864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e9d4ee35-1076-4d97-8660-d81d858c0a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:37.295307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e9d4ee35-1076-4d97-8660-d81d858c0a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:37.372312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e9d4ee35-1076-4d97-8660-d81d858c0a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.091054 Jan 15 15:52:37.373185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 329/659] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:37 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:38.190204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d72575fa-55df-4576-89e9-f7a951857f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:38.191055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d72575fa-55df-4576-89e9-f7a951857f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:38.197428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d72575fa-55df-4576-89e9-f7a951857f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:38.198561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d72575fa-55df-4576-89e9-f7a951857f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:38.199363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d72575fa-55df-4576-89e9-f7a951857f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:38.199802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d72575fa-55df-4576-89e9-f7a951857f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:38.227639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d72575fa-55df-4576-89e9-f7a951857f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Jan 15 15:52:38.228201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 331/660] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:38.384700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ff36ddd9-9169-4782-b1df-0748d0b60167 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:38.385766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ff36ddd9-9169-4782-b1df-0748d0b60167 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:38.392570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff36ddd9-9169-4782-b1df-0748d0b60167 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:38.393026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff36ddd9-9169-4782-b1df-0748d0b60167 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:38.393808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff36ddd9-9169-4782-b1df-0748d0b60167 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:38.394247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff36ddd9-9169-4782-b1df-0748d0b60167 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:38.454119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ff36ddd9-9169-4782-b1df-0748d0b60167 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.073379 Jan 15 15:52:38.454992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 330/661] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:38 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:39.238593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4c27ed04-7427-40d6-b2a2-1482b89176a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:39.239474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4c27ed04-7427-40d6-b2a2-1482b89176a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:39.245935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4c27ed04-7427-40d6-b2a2-1482b89176a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:39.246386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4c27ed04-7427-40d6-b2a2-1482b89176a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:39.247163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4c27ed04-7427-40d6-b2a2-1482b89176a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:39.247602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4c27ed04-7427-40d6-b2a2-1482b89176a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:39.276825 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4c27ed04-7427-40d6-b2a2-1482b89176a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041111 Jan 15 15:52:39.277369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 332/662] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:39.466999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cef63675-0322-40b1-9785-a29269630860 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:39.467997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cef63675-0322-40b1-9785-a29269630860 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:39.475078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cef63675-0322-40b1-9785-a29269630860 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:39.475530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cef63675-0322-40b1-9785-a29269630860 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:39.476342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cef63675-0322-40b1-9785-a29269630860 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:39.476784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cef63675-0322-40b1-9785-a29269630860 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:39.545071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cef63675-0322-40b1-9785-a29269630860 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.082797 Jan 15 15:52:39.545967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 331/663] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:39 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:40.287980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f74d99b2-ccb6-4681-89b2-a2c477aba94e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:40.288872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f74d99b2-ccb6-4681-89b2-a2c477aba94e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:40.296297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f74d99b2-ccb6-4681-89b2-a2c477aba94e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:40.296752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f74d99b2-ccb6-4681-89b2-a2c477aba94e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:40.297536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f74d99b2-ccb6-4681-89b2-a2c477aba94e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:40.297975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f74d99b2-ccb6-4681-89b2-a2c477aba94e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:40.325925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f74d99b2-ccb6-4681-89b2-a2c477aba94e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Jan 15 15:52:40.326466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 333/664] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:40.558139 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4043b57e-6467-4601-8a7f-2b72f01a615d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:40.559156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4043b57e-6467-4601-8a7f-2b72f01a615d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:40.565694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4043b57e-6467-4601-8a7f-2b72f01a615d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:40.566161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4043b57e-6467-4601-8a7f-2b72f01a615d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:40.566954 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4043b57e-6467-4601-8a7f-2b72f01a615d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:40.567392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4043b57e-6467-4601-8a7f-2b72f01a615d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:40.631428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4043b57e-6467-4601-8a7f-2b72f01a615d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.078259 Jan 15 15:52:40.632039 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 332/665] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:40 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:41.337186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4d0b8011-f4c6-4468-8275-b9a4aebb4f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:41.338031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4d0b8011-f4c6-4468-8275-b9a4aebb4f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:41.344352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4d0b8011-f4c6-4468-8275-b9a4aebb4f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:41.344810 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4d0b8011-f4c6-4468-8275-b9a4aebb4f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:41.345596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4d0b8011-f4c6-4468-8275-b9a4aebb4f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:41.346056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4d0b8011-f4c6-4468-8275-b9a4aebb4f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:41.375460 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4d0b8011-f4c6-4468-8275-b9a4aebb4f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Jan 15 15:52:41.376023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 334/666] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:41.643313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-930587a2-f01c-4138-b4a0-a6bec2ef5232 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:41.644353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-930587a2-f01c-4138-b4a0-a6bec2ef5232 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:41.651221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-930587a2-f01c-4138-b4a0-a6bec2ef5232 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:41.651671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-930587a2-f01c-4138-b4a0-a6bec2ef5232 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:41.652496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-930587a2-f01c-4138-b4a0-a6bec2ef5232 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:41.652935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-930587a2-f01c-4138-b4a0-a6bec2ef5232 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:41.715599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-930587a2-f01c-4138-b4a0-a6bec2ef5232 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.076279 Jan 15 15:52:41.716470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 333/667] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:41 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:42.387593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-21cbd859-1bbd-40b5-bf44-0c85064f6720 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:42.388527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-21cbd859-1bbd-40b5-bf44-0c85064f6720 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:42.394685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21cbd859-1bbd-40b5-bf44-0c85064f6720 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:42.397274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21cbd859-1bbd-40b5-bf44-0c85064f6720 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:42.397274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21cbd859-1bbd-40b5-bf44-0c85064f6720 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:42.397274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21cbd859-1bbd-40b5-bf44-0c85064f6720 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:42.425611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-21cbd859-1bbd-40b5-bf44-0c85064f6720 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042673 Jan 15 15:52:42.426155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 335/668] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:42.727135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7ce1a57b-0e4b-4d23-b73d-fe55c061d34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:42.728166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7ce1a57b-0e4b-4d23-b73d-fe55c061d34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:42.735071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce1a57b-0e4b-4d23-b73d-fe55c061d34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:42.735531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce1a57b-0e4b-4d23-b73d-fe55c061d34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:42.736476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce1a57b-0e4b-4d23-b73d-fe55c061d34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:42.736926 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7ce1a57b-0e4b-4d23-b73d-fe55c061d34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:42.812943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7ce1a57b-0e4b-4d23-b73d-fe55c061d34f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.089608 Jan 15 15:52:42.816812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 334/669] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:42 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:43.437894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-62731950-2806-4af9-9229-235f32a398d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:43.438724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-62731950-2806-4af9-9229-235f32a398d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:43.444974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62731950-2806-4af9-9229-235f32a398d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:43.445417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62731950-2806-4af9-9229-235f32a398d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:43.446193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62731950-2806-4af9-9229-235f32a398d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:43.446623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62731950-2806-4af9-9229-235f32a398d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:43.475743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-62731950-2806-4af9-9229-235f32a398d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 Jan 15 15:52:43.476319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 336/670] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:43.825019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aada4925-12f9-4c14-be6b-a3c9b7344d5a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:43.826018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aada4925-12f9-4c14-be6b-a3c9b7344d5a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:43.832836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aada4925-12f9-4c14-be6b-a3c9b7344d5a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:43.833287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aada4925-12f9-4c14-be6b-a3c9b7344d5a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:43.834102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aada4925-12f9-4c14-be6b-a3c9b7344d5a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:43.834545 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aada4925-12f9-4c14-be6b-a3c9b7344d5a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:43.899938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aada4925-12f9-4c14-be6b-a3c9b7344d5a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.078904 Jan 15 15:52:43.900874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 335/671] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:43 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:44.487462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c6afc379-12f1-4c83-a1cb-9c9d6487d88a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:44.488338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c6afc379-12f1-4c83-a1cb-9c9d6487d88a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:44.494690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6afc379-12f1-4c83-a1cb-9c9d6487d88a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:44.495149 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6afc379-12f1-4c83-a1cb-9c9d6487d88a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:44.495935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6afc379-12f1-4c83-a1cb-9c9d6487d88a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:44.496406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6afc379-12f1-4c83-a1cb-9c9d6487d88a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:44.524398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c6afc379-12f1-4c83-a1cb-9c9d6487d88a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040773 Jan 15 15:52:44.524941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 337/672] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:44.912426 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-af779323-d279-49c7-9d32-252accdb0b13 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:44.913433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-af779323-d279-49c7-9d32-252accdb0b13 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:44.920726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af779323-d279-49c7-9d32-252accdb0b13 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:44.921183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af779323-d279-49c7-9d32-252accdb0b13 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:44.921972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af779323-d279-49c7-9d32-252accdb0b13 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:44.922414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af779323-d279-49c7-9d32-252accdb0b13 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:44.986523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-af779323-d279-49c7-9d32-252accdb0b13 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.077588 Jan 15 15:52:44.987533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 336/673] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:44 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:45.536408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9eb55175-af07-4857-8a69-89805266f03f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:45.537243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9eb55175-af07-4857-8a69-89805266f03f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:45.544375 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9eb55175-af07-4857-8a69-89805266f03f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:45.544829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9eb55175-af07-4857-8a69-89805266f03f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:45.545604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9eb55175-af07-4857-8a69-89805266f03f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:45.546043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9eb55175-af07-4857-8a69-89805266f03f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:45.574489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9eb55175-af07-4857-8a69-89805266f03f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Jan 15 15:52:45.575037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 338/674] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:45.998756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-101298dc-aa69-435f-b963-c7210ca12b55 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:45.999892 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-101298dc-aa69-435f-b963-c7210ca12b55 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:46.006876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-101298dc-aa69-435f-b963-c7210ca12b55 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:46.007400 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-101298dc-aa69-435f-b963-c7210ca12b55 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:46.008362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-101298dc-aa69-435f-b963-c7210ca12b55 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:46.008867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-101298dc-aa69-435f-b963-c7210ca12b55 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:46.075040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-101298dc-aa69-435f-b963-c7210ca12b55 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.080112 Jan 15 15:52:46.075691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 337/675] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:45 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:46.585746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4b7e8615-5086-4a00-8eb0-f323f6644d26 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:46.586583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4b7e8615-5086-4a00-8eb0-f323f6644d26 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:46.592952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b7e8615-5086-4a00-8eb0-f323f6644d26 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:46.593402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b7e8615-5086-4a00-8eb0-f323f6644d26 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:46.594183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b7e8615-5086-4a00-8eb0-f323f6644d26 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:46.594624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4b7e8615-5086-4a00-8eb0-f323f6644d26 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:46.624283 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4b7e8615-5086-4a00-8eb0-f323f6644d26 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Jan 15 15:52:46.624831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 339/676] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:47.087046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5bc85571-5ec5-4cb9-93ad-280d8b6b6d0a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:47.088050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5bc85571-5ec5-4cb9-93ad-280d8b6b6d0a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:47.095283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5bc85571-5ec5-4cb9-93ad-280d8b6b6d0a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:47.095752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5bc85571-5ec5-4cb9-93ad-280d8b6b6d0a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:47.096568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5bc85571-5ec5-4cb9-93ad-280d8b6b6d0a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:47.097013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5bc85571-5ec5-4cb9-93ad-280d8b6b6d0a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:47.157018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5bc85571-5ec5-4cb9-93ad-280d8b6b6d0a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.073816 Jan 15 15:52:47.157646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 338/677] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:47 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:47.635049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ef6c5ec8-3d95-4842-9ee7-ca621e40873f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:47.636553 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ef6c5ec8-3d95-4842-9ee7-ca621e40873f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:47.642889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef6c5ec8-3d95-4842-9ee7-ca621e40873f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:47.643376 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef6c5ec8-3d95-4842-9ee7-ca621e40873f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:47.644162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef6c5ec8-3d95-4842-9ee7-ca621e40873f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:47.644606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ef6c5ec8-3d95-4842-9ee7-ca621e40873f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:47.674198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ef6c5ec8-3d95-4842-9ee7-ca621e40873f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Jan 15 15:52:47.674948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 340/678] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:48.169236 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a69b7b05-2854-4140-8f89-5c0445b6d82f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:48.170247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a69b7b05-2854-4140-8f89-5c0445b6d82f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:48.177150 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a69b7b05-2854-4140-8f89-5c0445b6d82f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:48.177603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a69b7b05-2854-4140-8f89-5c0445b6d82f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:48.178385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a69b7b05-2854-4140-8f89-5c0445b6d82f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:48.178823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a69b7b05-2854-4140-8f89-5c0445b6d82f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:48.686407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0bbe6957-437a-4235-9382-4f3161d475a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:48.687324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0bbe6957-437a-4235-9382-4f3161d475a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:48.693779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bbe6957-437a-4235-9382-4f3161d475a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:48.694233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bbe6957-437a-4235-9382-4f3161d475a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:48.695026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bbe6957-437a-4235-9382-4f3161d475a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:48.695469 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bbe6957-437a-4235-9382-4f3161d475a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:48.728918 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0bbe6957-437a-4235-9382-4f3161d475a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047123 Jan 15 15:52:48.729510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 341/679] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:49.740466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-039cd90b-bf93-4958-800f-fbc5e94e96ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:49.741293 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-039cd90b-bf93-4958-800f-fbc5e94e96ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:49.748970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-039cd90b-bf93-4958-800f-fbc5e94e96ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:49.749412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-039cd90b-bf93-4958-800f-fbc5e94e96ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:49.750188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-039cd90b-bf93-4958-800f-fbc5e94e96ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:49.750618 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-039cd90b-bf93-4958-800f-fbc5e94e96ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:49.780403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-039cd90b-bf93-4958-800f-fbc5e94e96ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043707 Jan 15 15:52:49.780965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 342/680] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:50.792839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c1fe3e6b-eb84-4353-b3d8-26b6fc3abe5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:50.793754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c1fe3e6b-eb84-4353-b3d8-26b6fc3abe5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:50.799967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1fe3e6b-eb84-4353-b3d8-26b6fc3abe5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:50.800447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1fe3e6b-eb84-4353-b3d8-26b6fc3abe5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:50.801224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1fe3e6b-eb84-4353-b3d8-26b6fc3abe5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:50.801653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1fe3e6b-eb84-4353-b3d8-26b6fc3abe5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:50.830706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c1fe3e6b-eb84-4353-b3d8-26b6fc3abe5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Jan 15 15:52:50.831257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 343/681] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:52:51.461405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a69b7b05-2854-4140-8f89-5c0445b6d82f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 3.296355 Jan 15 15:52:51.462132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 339/682] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:48 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 3298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:51.842718 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-69779103-1890-4648-bc87-7c9523a47428 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:51.843604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-69779103-1890-4648-bc87-7c9523a47428 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:51.850047 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69779103-1890-4648-bc87-7c9523a47428 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:51.850520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69779103-1890-4648-bc87-7c9523a47428 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:51.851286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69779103-1890-4648-bc87-7c9523a47428 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:51.851715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69779103-1890-4648-bc87-7c9523a47428 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:51.879912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-69779103-1890-4648-bc87-7c9523a47428 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041943 Jan 15 15:52:51.880477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 344/683] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:52.473543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-91f35975-5719-4393-8f5e-2c626104c714 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:52.474516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-91f35975-5719-4393-8f5e-2c626104c714 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:52.482107 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91f35975-5719-4393-8f5e-2c626104c714 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:52.482563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91f35975-5719-4393-8f5e-2c626104c714 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:52.483357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91f35975-5719-4393-8f5e-2c626104c714 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:52.483804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91f35975-5719-4393-8f5e-2c626104c714 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:52.546170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-91f35975-5719-4393-8f5e-2c626104c714 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.076605 Jan 15 15:52:52.546785 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 340/684] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:52 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:52.891315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-eba52509-6f0a-419c-8c90-d40d62c85ea5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:52.892259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-eba52509-6f0a-419c-8c90-d40d62c85ea5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:52.898426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eba52509-6f0a-419c-8c90-d40d62c85ea5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:52.898869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eba52509-6f0a-419c-8c90-d40d62c85ea5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:52.899634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eba52509-6f0a-419c-8c90-d40d62c85ea5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:52.900072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eba52509-6f0a-419c-8c90-d40d62c85ea5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:52.928447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-eba52509-6f0a-419c-8c90-d40d62c85ea5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040822 Jan 15 15:52:52.928995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 345/685] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:53.558763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-416bda29-f444-4113-92ff-e875e4ba2a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:53.559788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-416bda29-f444-4113-92ff-e875e4ba2a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:53.566630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-416bda29-f444-4113-92ff-e875e4ba2a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:53.567085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-416bda29-f444-4113-92ff-e875e4ba2a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:53.567866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-416bda29-f444-4113-92ff-e875e4ba2a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:53.568338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-416bda29-f444-4113-92ff-e875e4ba2a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:53.631379 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-416bda29-f444-4113-92ff-e875e4ba2a85 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.077198 Jan 15 15:52:53.632088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 341/686] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:53 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:53.939546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7ac24f5e-e1a4-448e-98b7-84fa704015bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:53.940500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7ac24f5e-e1a4-448e-98b7-84fa704015bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:53.946746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ac24f5e-e1a4-448e-98b7-84fa704015bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:53.947199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ac24f5e-e1a4-448e-98b7-84fa704015bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:53.948625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ac24f5e-e1a4-448e-98b7-84fa704015bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:53.949072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ac24f5e-e1a4-448e-98b7-84fa704015bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:53.976872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7ac24f5e-e1a4-448e-98b7-84fa704015bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Jan 15 15:52:53.977417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 346/687] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:54.643313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c631db2b-ffde-4cba-a4a1-423fc316c546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:54.644374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c631db2b-ffde-4cba-a4a1-423fc316c546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:54.651730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631db2b-ffde-4cba-a4a1-423fc316c546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:54.652211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631db2b-ffde-4cba-a4a1-423fc316c546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:54.653002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631db2b-ffde-4cba-a4a1-423fc316c546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:54.653441 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631db2b-ffde-4cba-a4a1-423fc316c546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:54.713337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c631db2b-ffde-4cba-a4a1-423fc316c546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.073878 Jan 15 15:52:54.714541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 342/688] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:54 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:54.988935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9cfbb1ce-e0d8-474d-97d8-52bb12d6b330 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:54.989884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9cfbb1ce-e0d8-474d-97d8-52bb12d6b330 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:54.996253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cfbb1ce-e0d8-474d-97d8-52bb12d6b330 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:54.996706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cfbb1ce-e0d8-474d-97d8-52bb12d6b330 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:54.997490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cfbb1ce-e0d8-474d-97d8-52bb12d6b330 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:54.997927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cfbb1ce-e0d8-474d-97d8-52bb12d6b330 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:55.027029 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9cfbb1ce-e0d8-474d-97d8-52bb12d6b330 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041132 Jan 15 15:52:55.027902 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 347/689] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:55.726158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7792c41b-daa4-4c51-b2af-56ac58162adc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:55.727159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7792c41b-daa4-4c51-b2af-56ac58162adc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:55.734763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7792c41b-daa4-4c51-b2af-56ac58162adc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:55.735224 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7792c41b-daa4-4c51-b2af-56ac58162adc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:55.736007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7792c41b-daa4-4c51-b2af-56ac58162adc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:55.736479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7792c41b-daa4-4c51-b2af-56ac58162adc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:55.802136 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7792c41b-daa4-4c51-b2af-56ac58162adc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.079768 Jan 15 15:52:55.802765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 343/690] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:55 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:56.040890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ac86ca75-8f92-41a6-9e2e-eccdbbf7284a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:56.042597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ac86ca75-8f92-41a6-9e2e-eccdbbf7284a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:56.049482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac86ca75-8f92-41a6-9e2e-eccdbbf7284a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:56.049929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac86ca75-8f92-41a6-9e2e-eccdbbf7284a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:56.050716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac86ca75-8f92-41a6-9e2e-eccdbbf7284a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:56.051167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac86ca75-8f92-41a6-9e2e-eccdbbf7284a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:56.079437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ac86ca75-8f92-41a6-9e2e-eccdbbf7284a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Jan 15 15:52:56.079987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 348/691] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:56.815071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3e064719-9467-4edf-acf5-db49d6ebb3dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:56.816002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3e064719-9467-4edf-acf5-db49d6ebb3dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:56.822795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e064719-9467-4edf-acf5-db49d6ebb3dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:56.823867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e064719-9467-4edf-acf5-db49d6ebb3dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:56.824674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e064719-9467-4edf-acf5-db49d6ebb3dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:56.825113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e064719-9467-4edf-acf5-db49d6ebb3dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:56.885068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3e064719-9467-4edf-acf5-db49d6ebb3dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.073924 Jan 15 15:52:56.886471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 344/692] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:56 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:57.091117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-897afbff-ba3e-464b-933c-10a5134c6757 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:57.091952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-897afbff-ba3e-464b-933c-10a5134c6757 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:57.098174 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-897afbff-ba3e-464b-933c-10a5134c6757 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:57.098620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-897afbff-ba3e-464b-933c-10a5134c6757 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:57.099389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-897afbff-ba3e-464b-933c-10a5134c6757 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:57.099830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-897afbff-ba3e-464b-933c-10a5134c6757 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:57.129050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-897afbff-ba3e-464b-933c-10a5134c6757 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Jan 15 15:52:57.129592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 349/693] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:57.897998 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cdce25ad-382f-4838-ab60-6e3244d65ec7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:57.899003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cdce25ad-382f-4838-ab60-6e3244d65ec7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:57.906828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdce25ad-382f-4838-ab60-6e3244d65ec7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:57.907277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdce25ad-382f-4838-ab60-6e3244d65ec7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:57.908044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdce25ad-382f-4838-ab60-6e3244d65ec7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:57.908510 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdce25ad-382f-4838-ab60-6e3244d65ec7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:57.989344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cdce25ad-382f-4838-ab60-6e3244d65ec7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.095290 Jan 15 15:52:57.989975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 345/694] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:57 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:58.140976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f19f2844-a714-46a8-9bab-256983a4bbdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:58.142002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f19f2844-a714-46a8-9bab-256983a4bbdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:58.148249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f19f2844-a714-46a8-9bab-256983a4bbdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:58.148642 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f19f2844-a714-46a8-9bab-256983a4bbdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:58.149413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f19f2844-a714-46a8-9bab-256983a4bbdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:58.149849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f19f2844-a714-46a8-9bab-256983a4bbdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:58.179633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f19f2844-a714-46a8-9bab-256983a4bbdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042396 Jan 15 15:52:58.180198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 350/695] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:52:59.000802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0c9e7b21-8bee-4ccb-bdbd-bc8119331003 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:52:59.001804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0c9e7b21-8bee-4ccb-bdbd-bc8119331003 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:59.008631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c9e7b21-8bee-4ccb-bdbd-bc8119331003 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:59.009142 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c9e7b21-8bee-4ccb-bdbd-bc8119331003 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:59.009934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c9e7b21-8bee-4ccb-bdbd-bc8119331003 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:59.010384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c9e7b21-8bee-4ccb-bdbd-bc8119331003 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:59.085716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0c9e7b21-8bee-4ccb-bdbd-bc8119331003 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28623 microversion: 2.1 time: 0.088785 Jan 15 15:52:59.086381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 346/696] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:52:58 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28623 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:52:59.190528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-43296f08-a5a6-4fb3-9094-25f284bd0bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:52:59.191439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-43296f08-a5a6-4fb3-9094-25f284bd0bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:52:59.197705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43296f08-a5a6-4fb3-9094-25f284bd0bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:59.198224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43296f08-a5a6-4fb3-9094-25f284bd0bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:59.199032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43296f08-a5a6-4fb3-9094-25f284bd0bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:52:59.199471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43296f08-a5a6-4fb3-9094-25f284bd0bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:52:59.227579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-43296f08-a5a6-4fb3-9094-25f284bd0bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Jan 15 15:52:59.228121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 351/697] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:52:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:00.098329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5a1e5a32-6fa9-44cb-817e-a8cb5d89cab4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:00.099341 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5a1e5a32-6fa9-44cb-817e-a8cb5d89cab4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:00.106915 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a1e5a32-6fa9-44cb-817e-a8cb5d89cab4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:00.107370 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a1e5a32-6fa9-44cb-817e-a8cb5d89cab4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:00.108177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a1e5a32-6fa9-44cb-817e-a8cb5d89cab4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:00.108618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a1e5a32-6fa9-44cb-817e-a8cb5d89cab4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:00.187467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5a1e5a32-6fa9-44cb-817e-a8cb5d89cab4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 28719 microversion: 2.1 time: 0.093030 Jan 15 15:53:00.188367 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 347/698] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:00 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 28719 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:00.239085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fea96d88-c26c-4be7-828b-4289f00fe5ad tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:00.240024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fea96d88-c26c-4be7-828b-4289f00fe5ad tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:00.247126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fea96d88-c26c-4be7-828b-4289f00fe5ad tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:00.247644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fea96d88-c26c-4be7-828b-4289f00fe5ad tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:00.248449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fea96d88-c26c-4be7-828b-4289f00fe5ad tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:00.248891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fea96d88-c26c-4be7-828b-4289f00fe5ad tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:00.277277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fea96d88-c26c-4be7-828b-4289f00fe5ad tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Jan 15 15:53:00.277827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 352/699] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:01.199412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9a466ec0-3f8a-43b1-b80b-0a61893dbd07 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:01.200487 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9a466ec0-3f8a-43b1-b80b-0a61893dbd07 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:01.207318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a466ec0-3f8a-43b1-b80b-0a61893dbd07 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:01.207775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a466ec0-3f8a-43b1-b80b-0a61893dbd07 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:01.208598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a466ec0-3f8a-43b1-b80b-0a61893dbd07 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:01.209048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a466ec0-3f8a-43b1-b80b-0a61893dbd07 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:01.285963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9a466ec0-3f8a-43b1-b80b-0a61893dbd07 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 30724 microversion: 2.1 time: 0.090581 Jan 15 15:53:01.287423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 348/700] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:01 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 30724 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:01.288712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-21f62ad9-e2df-4d8e-8bb7-d28de6bcda93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:01.289627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-21f62ad9-e2df-4d8e-8bb7-d28de6bcda93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:01.296816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21f62ad9-e2df-4d8e-8bb7-d28de6bcda93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:01.297258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21f62ad9-e2df-4d8e-8bb7-d28de6bcda93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:01.298025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21f62ad9-e2df-4d8e-8bb7-d28de6bcda93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:01.298453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-21f62ad9-e2df-4d8e-8bb7-d28de6bcda93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:01.327058 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-21f62ad9-e2df-4d8e-8bb7-d28de6bcda93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 Jan 15 15:53:01.327696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 353/701] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:53:02.298444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fd720048-c8ac-4475-8e8e-a4a7c6d287ee tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:02.299360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fd720048-c8ac-4475-8e8e-a4a7c6d287ee tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:02.306255 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd720048-c8ac-4475-8e8e-a4a7c6d287ee tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:02.306710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd720048-c8ac-4475-8e8e-a4a7c6d287ee tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:02.308285 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd720048-c8ac-4475-8e8e-a4a7c6d287ee tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:02.308723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd720048-c8ac-4475-8e8e-a4a7c6d287ee tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:02.339478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b5c4c7b1-27cc-4a6a-88d3-dca6a581caf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:02.340410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b5c4c7b1-27cc-4a6a-88d3-dca6a581caf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:02.346581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7b1-27cc-4a6a-88d3-dca6a581caf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:02.347057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7b1-27cc-4a6a-88d3-dca6a581caf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:02.347847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7b1-27cc-4a6a-88d3-dca6a581caf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:02.348301 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7b1-27cc-4a6a-88d3-dca6a581caf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:02.377747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b5c4c7b1-27cc-4a6a-88d3-dca6a581caf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042254 Jan 15 15:53:02.378301 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 354/702] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:53:02.386416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fd720048-c8ac-4475-8e8e-a4a7c6d287ee tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 32616 microversion: 2.1 time: 0.091794 Jan 15 15:53:02.387059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 349/703] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:02 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 32616 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:03.390005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e7ac61c0-bd07-4d69-be62-9e3245115eee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:03.391746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e7ac61c0-bd07-4d69-be62-9e3245115eee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:03.397666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e7ac61c0-bd07-4d69-be62-9e3245115eee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:03.398115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e7ac61c0-bd07-4d69-be62-9e3245115eee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:03.398694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b603875b-72aa-4d22-b394-5cc8a525ba18 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:03.399138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e7ac61c0-bd07-4d69-be62-9e3245115eee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:03.399307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e7ac61c0-bd07-4d69-be62-9e3245115eee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:03.399880 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b603875b-72aa-4d22-b394-5cc8a525ba18 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:03.408062 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b603875b-72aa-4d22-b394-5cc8a525ba18 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:03.408684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b603875b-72aa-4d22-b394-5cc8a525ba18 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:03.409489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b603875b-72aa-4d22-b394-5cc8a525ba18 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:03.410054 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b603875b-72aa-4d22-b394-5cc8a525ba18 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:03.433768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e7ac61c0-bd07-4d69-be62-9e3245115eee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047365 Jan 15 15:53:03.434338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 355/704] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:03.497313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b603875b-72aa-4d22-b394-5cc8a525ba18 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 33598 microversion: 2.1 time: 0.102734 Jan 15 15:53:03.497960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 350/705] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:03 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 33598 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:53:04.445069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c7d4a94b-b151-45aa-9715-817672c856f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:04.445984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c7d4a94b-b151-45aa-9715-817672c856f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:04.452370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7d4a94b-b151-45aa-9715-817672c856f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:04.452820 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7d4a94b-b151-45aa-9715-817672c856f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:04.453597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7d4a94b-b151-45aa-9715-817672c856f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:04.454030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7d4a94b-b151-45aa-9715-817672c856f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:04.483399 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c7d4a94b-b151-45aa-9715-817672c856f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Jan 15 15:53:04.483955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 356/706] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:04.508462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-37875439-0f9b-4a66-ac26-3466dcc08125 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:04.509613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-37875439-0f9b-4a66-ac26-3466dcc08125 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:04.516913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37875439-0f9b-4a66-ac26-3466dcc08125 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:04.517367 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37875439-0f9b-4a66-ac26-3466dcc08125 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:04.518217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37875439-0f9b-4a66-ac26-3466dcc08125 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:04.518659 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37875439-0f9b-4a66-ac26-3466dcc08125 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:04.605574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-37875439-0f9b-4a66-ac26-3466dcc08125 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 34742 microversion: 2.1 time: 0.100940 Jan 15 15:53:04.606479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 351/707] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:04 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 34742 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:05.495391 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b546bc1a-0096-4f45-8c7b-19bcf65eef04 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:05.496364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b546bc1a-0096-4f45-8c7b-19bcf65eef04 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:05.502838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b546bc1a-0096-4f45-8c7b-19bcf65eef04 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:05.503324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b546bc1a-0096-4f45-8c7b-19bcf65eef04 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:05.504111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b546bc1a-0096-4f45-8c7b-19bcf65eef04 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:05.504578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b546bc1a-0096-4f45-8c7b-19bcf65eef04 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:05.532563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b546bc1a-0096-4f45-8c7b-19bcf65eef04 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Jan 15 15:53:05.533106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 357/708] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:05.618055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7cff0579-fad9-4a68-a84c-00415a971764 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:05.620104 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7cff0579-fad9-4a68-a84c-00415a971764 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:05.627587 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7cff0579-fad9-4a68-a84c-00415a971764 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:05.628046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7cff0579-fad9-4a68-a84c-00415a971764 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:05.628951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7cff0579-fad9-4a68-a84c-00415a971764 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:05.629436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7cff0579-fad9-4a68-a84c-00415a971764 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:05.702431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7cff0579-fad9-4a68-a84c-00415a971764 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 35794 microversion: 2.1 time: 0.088306 Jan 15 15:53:05.703076 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 352/709] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:05 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 35794 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:06.543770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-063e4c40-de1d-403a-a186-5aff9556a224 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:06.544714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-063e4c40-de1d-403a-a186-5aff9556a224 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:06.550939 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-063e4c40-de1d-403a-a186-5aff9556a224 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:06.551388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-063e4c40-de1d-403a-a186-5aff9556a224 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:06.552184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-063e4c40-de1d-403a-a186-5aff9556a224 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:06.552627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-063e4c40-de1d-403a-a186-5aff9556a224 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:06.580167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-063e4c40-de1d-403a-a186-5aff9556a224 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041061 Jan 15 15:53:06.580718 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 358/710] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:06.714845 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0deead1d-caf4-4965-8bc7-8b8fc152570f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:06.715845 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0deead1d-caf4-4965-8bc7-8b8fc152570f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:06.722709 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0deead1d-caf4-4965-8bc7-8b8fc152570f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:06.723171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0deead1d-caf4-4965-8bc7-8b8fc152570f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:06.723947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0deead1d-caf4-4965-8bc7-8b8fc152570f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:06.724422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0deead1d-caf4-4965-8bc7-8b8fc152570f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:06.801984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0deead1d-caf4-4965-8bc7-8b8fc152570f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 37350 microversion: 2.1 time: 0.091493 Jan 15 15:53:06.802849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 353/711] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:06 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 37350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:07.591510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7966029a-12ce-47e5-80d6-bece0c17d429 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:07.592446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7966029a-12ce-47e5-80d6-bece0c17d429 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:07.598645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7966029a-12ce-47e5-80d6-bece0c17d429 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:07.599089 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7966029a-12ce-47e5-80d6-bece0c17d429 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:07.599857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7966029a-12ce-47e5-80d6-bece0c17d429 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:07.600324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7966029a-12ce-47e5-80d6-bece0c17d429 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:07.629508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7966029a-12ce-47e5-80d6-bece0c17d429 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 Jan 15 15:53:07.630060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 359/712] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:07.814460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3cb67417-6d84-4df4-a71c-98793cbab737 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:07.815459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3cb67417-6d84-4df4-a71c-98793cbab737 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:07.822617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cb67417-6d84-4df4-a71c-98793cbab737 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:07.823079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cb67417-6d84-4df4-a71c-98793cbab737 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:07.823869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cb67417-6d84-4df4-a71c-98793cbab737 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:07.824471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cb67417-6d84-4df4-a71c-98793cbab737 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:07.936844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3cb67417-6d84-4df4-a71c-98793cbab737 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 38157 microversion: 2.1 time: 0.126238 Jan 15 15:53:07.937478 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 354/713] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:07 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 38157 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:08.640987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-63bb4a88-e276-4f93-9179-5c3b96ba8e14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:08.641933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-63bb4a88-e276-4f93-9179-5c3b96ba8e14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:08.648186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63bb4a88-e276-4f93-9179-5c3b96ba8e14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:08.648645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63bb4a88-e276-4f93-9179-5c3b96ba8e14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:08.649419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63bb4a88-e276-4f93-9179-5c3b96ba8e14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:08.649858 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63bb4a88-e276-4f93-9179-5c3b96ba8e14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:08.678438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-63bb4a88-e276-4f93-9179-5c3b96ba8e14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Jan 15 15:53:08.678985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 360/714] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:08.949493 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bd4ca066-9f6c-44d3-88d7-8edd3866564f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:08.950416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bd4ca066-9f6c-44d3-88d7-8edd3866564f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:08.957294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd4ca066-9f6c-44d3-88d7-8edd3866564f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:08.957743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd4ca066-9f6c-44d3-88d7-8edd3866564f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:08.958558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd4ca066-9f6c-44d3-88d7-8edd3866564f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:08.958982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd4ca066-9f6c-44d3-88d7-8edd3866564f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:09.028555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bd4ca066-9f6c-44d3-88d7-8edd3866564f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 38157 microversion: 2.1 time: 0.083278 Jan 15 15:53:09.030835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 355/715] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:08 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 38157 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:09.690393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-837f0a17-257a-4d70-8c53-1606d424678e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:09.691295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-837f0a17-257a-4d70-8c53-1606d424678e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:09.698295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-837f0a17-257a-4d70-8c53-1606d424678e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:09.698945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-837f0a17-257a-4d70-8c53-1606d424678e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:09.699720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-837f0a17-257a-4d70-8c53-1606d424678e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:09.700176 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-837f0a17-257a-4d70-8c53-1606d424678e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:09.728884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-837f0a17-257a-4d70-8c53-1606d424678e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Jan 15 15:53:09.729603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 361/716] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:10.041063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-38fe6a92-18ec-4316-a01a-bb90acc50270 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:10.042606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-38fe6a92-18ec-4316-a01a-bb90acc50270 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:10.049441 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38fe6a92-18ec-4316-a01a-bb90acc50270 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:10.049898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38fe6a92-18ec-4316-a01a-bb90acc50270 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:10.050689 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38fe6a92-18ec-4316-a01a-bb90acc50270 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:10.051163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38fe6a92-18ec-4316-a01a-bb90acc50270 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:10.125734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-38fe6a92-18ec-4316-a01a-bb90acc50270 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 38157 microversion: 2.1 time: 0.088826 Jan 15 15:53:10.126666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 356/717] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:10 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 38157 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:10.740195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-74d53ff8-a89b-48a8-93b1-6020cbccebbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:10.741105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-74d53ff8-a89b-48a8-93b1-6020cbccebbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:10.747734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74d53ff8-a89b-48a8-93b1-6020cbccebbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:10.748201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74d53ff8-a89b-48a8-93b1-6020cbccebbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:10.748972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74d53ff8-a89b-48a8-93b1-6020cbccebbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:10.749403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74d53ff8-a89b-48a8-93b1-6020cbccebbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:10.779257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-74d53ff8-a89b-48a8-93b1-6020cbccebbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043009 Jan 15 15:53:10.779812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 362/718] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:11.138753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-de56ef66-f3de-4f69-9241-0bbb86b6385c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:11.139750 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-de56ef66-f3de-4f69-9241-0bbb86b6385c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:11.146540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-de56ef66-f3de-4f69-9241-0bbb86b6385c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:11.146986 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-de56ef66-f3de-4f69-9241-0bbb86b6385c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:11.147760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-de56ef66-f3de-4f69-9241-0bbb86b6385c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:11.148230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-de56ef66-f3de-4f69-9241-0bbb86b6385c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:11.215295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-de56ef66-f3de-4f69-9241-0bbb86b6385c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 38157 microversion: 2.1 time: 0.081144 Jan 15 15:53:11.215943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 357/719] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:11 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 38157 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:11.790812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d3f4f4d6-37b9-4a03-8dac-0ea999b1b781 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:11.792457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d3f4f4d6-37b9-4a03-8dac-0ea999b1b781 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:11.799017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3f4f4d6-37b9-4a03-8dac-0ea999b1b781 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:11.799465 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3f4f4d6-37b9-4a03-8dac-0ea999b1b781 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:11.800274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3f4f4d6-37b9-4a03-8dac-0ea999b1b781 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:11.800742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3f4f4d6-37b9-4a03-8dac-0ea999b1b781 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:11.828872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d3f4f4d6-37b9-4a03-8dac-0ea999b1b781 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042030 Jan 15 15:53:11.829422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 363/720] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:12.227423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-76eb9914-c91b-42ff-a2b3-8a346b62a3db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:53:12.228488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-76eb9914-c91b-42ff-a2b3-8a346b62a3db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:12.235251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76eb9914-c91b-42ff-a2b3-8a346b62a3db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:12.235704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76eb9914-c91b-42ff-a2b3-8a346b62a3db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:12.236520 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76eb9914-c91b-42ff-a2b3-8a346b62a3db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:12.236965 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76eb9914-c91b-42ff-a2b3-8a346b62a3db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:12.317088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-76eb9914-c91b-42ff-a2b3-8a346b62a3db tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action" status: 200 len: 38288 microversion: 2.1 time: 0.093556 Jan 15 15:53:12.318279 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 358/721] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:53:12 2022] POST /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/action => generated 38288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:53:12.327939 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a039d0d6-9ada-47f1-b4ae-46063db41c25 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:12.328515 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a039d0d6-9ada-47f1-b4ae-46063db41c25 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:12.334284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a039d0d6-9ada-47f1-b4ae-46063db41c25 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:12.334741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a039d0d6-9ada-47f1-b4ae-46063db41c25 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:12.335522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a039d0d6-9ada-47f1-b4ae-46063db41c25 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:12.335958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a039d0d6-9ada-47f1-b4ae-46063db41c25 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:12.359407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a039d0d6-9ada-47f1-b4ae-46063db41c25 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/ips" status: 200 len: 146 microversion: 2.1 time: 0.035018 Jan 15 15:53:12.364240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 364/722] 10.222.0.36 () {58 vars in 1247 bytes} [Sat Jan 15 15:53:12 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:12.841343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-88e7336d-3955-4a9e-ad3e-9705ad3e934d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:12.842340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-88e7336d-3955-4a9e-ad3e-9705ad3e934d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:12.849145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-88e7336d-3955-4a9e-ad3e-9705ad3e934d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:12.849590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-88e7336d-3955-4a9e-ad3e-9705ad3e934d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:12.850366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-88e7336d-3955-4a9e-ad3e-9705ad3e934d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:12.850798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-88e7336d-3955-4a9e-ad3e-9705ad3e934d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:12.881261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-88e7336d-3955-4a9e-ad3e-9705ad3e934d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Jan 15 15:53:12.881811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 359/723] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:13.892777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a88af3bb-9dc1-4e7f-b0cf-fb33ac545263 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:13.897461 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a88af3bb-9dc1-4e7f-b0cf-fb33ac545263 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:13.900179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a88af3bb-9dc1-4e7f-b0cf-fb33ac545263 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:13.900635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a88af3bb-9dc1-4e7f-b0cf-fb33ac545263 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:13.901446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a88af3bb-9dc1-4e7f-b0cf-fb33ac545263 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:13.901899 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a88af3bb-9dc1-4e7f-b0cf-fb33ac545263 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:13.931217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a88af3bb-9dc1-4e7f-b0cf-fb33ac545263 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Jan 15 15:53:13.932175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 365/724] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:14.943130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2cd00b4a-7886-48b3-8149-77e84d58f857 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:14.944041 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2cd00b4a-7886-48b3-8149-77e84d58f857 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:14.951197 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2cd00b4a-7886-48b3-8149-77e84d58f857 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:14.951656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2cd00b4a-7886-48b3-8149-77e84d58f857 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:14.952471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2cd00b4a-7886-48b3-8149-77e84d58f857 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:14.952914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2cd00b4a-7886-48b3-8149-77e84d58f857 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:14.981585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2cd00b4a-7886-48b3-8149-77e84d58f857 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042126 Jan 15 15:53:14.982075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 360/725] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:15.991694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b439493c-055c-4716-9ce6-1695026b1435 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:15.992744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b439493c-055c-4716-9ce6-1695026b1435 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:15.999547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b439493c-055c-4716-9ce6-1695026b1435 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:15.999991 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b439493c-055c-4716-9ce6-1695026b1435 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:16.000792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b439493c-055c-4716-9ce6-1695026b1435 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:16.001224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b439493c-055c-4716-9ce6-1695026b1435 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:16.028944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b439493c-055c-4716-9ce6-1695026b1435 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Jan 15 15:53:16.029505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 366/726] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:17.040112 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a140d2ca-3976-49c1-b322-c95d752c54b2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:17.041056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a140d2ca-3976-49c1-b322-c95d752c54b2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:17.047338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a140d2ca-3976-49c1-b322-c95d752c54b2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:17.047795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a140d2ca-3976-49c1-b322-c95d752c54b2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:17.048632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a140d2ca-3976-49c1-b322-c95d752c54b2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:17.049081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a140d2ca-3976-49c1-b322-c95d752c54b2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:17.078426 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a140d2ca-3976-49c1-b322-c95d752c54b2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Jan 15 15:53:17.078972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 361/727] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:17.650196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:53:17.650373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 15:53:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:53:18.089742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-886c43e1-9e25-4a74-9d38-bff2252012ed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:18.090583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-886c43e1-9e25-4a74-9d38-bff2252012ed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:18.096969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-886c43e1-9e25-4a74-9d38-bff2252012ed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:18.097414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-886c43e1-9e25-4a74-9d38-bff2252012ed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:18.098180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-886c43e1-9e25-4a74-9d38-bff2252012ed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:18.098610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-886c43e1-9e25-4a74-9d38-bff2252012ed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:18.127428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-886c43e1-9e25-4a74-9d38-bff2252012ed tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041579 Jan 15 15:53:18.127966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 367/728] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:19.138608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-80e60088-b5df-4043-be86-2f0a75eebee0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:19.139527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-80e60088-b5df-4043-be86-2f0a75eebee0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:19.145948 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80e60088-b5df-4043-be86-2f0a75eebee0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:19.146405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80e60088-b5df-4043-be86-2f0a75eebee0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:19.147189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80e60088-b5df-4043-be86-2f0a75eebee0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:19.147630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80e60088-b5df-4043-be86-2f0a75eebee0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:19.178280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-80e60088-b5df-4043-be86-2f0a75eebee0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Jan 15 15:53:19.178862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 362/729] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:20.190150 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5acaeec8-0de0-4c9b-ae39-9dc5f9140bf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:20.191074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5acaeec8-0de0-4c9b-ae39-9dc5f9140bf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:20.197462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5acaeec8-0de0-4c9b-ae39-9dc5f9140bf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:20.197912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5acaeec8-0de0-4c9b-ae39-9dc5f9140bf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:20.198692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5acaeec8-0de0-4c9b-ae39-9dc5f9140bf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:20.199734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5acaeec8-0de0-4c9b-ae39-9dc5f9140bf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:20.227744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5acaeec8-0de0-4c9b-ae39-9dc5f9140bf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Jan 15 15:53:20.228321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 368/730] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:21.238822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c3c5900e-a3b8-43e2-b6d9-0b488ae27461 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:21.239736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c3c5900e-a3b8-43e2-b6d9-0b488ae27461 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:21.246136 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c3c5900e-a3b8-43e2-b6d9-0b488ae27461 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:21.246599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c3c5900e-a3b8-43e2-b6d9-0b488ae27461 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:21.247375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c3c5900e-a3b8-43e2-b6d9-0b488ae27461 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:21.247812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c3c5900e-a3b8-43e2-b6d9-0b488ae27461 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:21.275698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c3c5900e-a3b8-43e2-b6d9-0b488ae27461 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040624 Jan 15 15:53:21.276252 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 363/731] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:22.463976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-05f63d43-6201-4ff8-826d-791aa5aa41a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:22.466180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-05f63d43-6201-4ff8-826d-791aa5aa41a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:22.471984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f63d43-6201-4ff8-826d-791aa5aa41a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:22.472529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f63d43-6201-4ff8-826d-791aa5aa41a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:22.473433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f63d43-6201-4ff8-826d-791aa5aa41a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:22.474097 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f63d43-6201-4ff8-826d-791aa5aa41a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:22.504212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-05f63d43-6201-4ff8-826d-791aa5aa41a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220204 Jan 15 15:53:22.504957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 369/732] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:23.515346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f05b5f27-0c37-44da-a62f-6e2fd9aba856 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:23.516311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f05b5f27-0c37-44da-a62f-6e2fd9aba856 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:23.522570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f05b5f27-0c37-44da-a62f-6e2fd9aba856 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:23.523030 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f05b5f27-0c37-44da-a62f-6e2fd9aba856 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:23.523840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f05b5f27-0c37-44da-a62f-6e2fd9aba856 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:23.525752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f05b5f27-0c37-44da-a62f-6e2fd9aba856 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:23.556392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f05b5f27-0c37-44da-a62f-6e2fd9aba856 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045364 Jan 15 15:53:23.560324 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 364/733] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:24.282476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:53:24.288036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 15:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:53:24.305242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:53:24.305699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 15:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:53:24.569666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c3ef33f9-6a28-4bbf-8ed1-f9a8a3678c25 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:24.570571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c3ef33f9-6a28-4bbf-8ed1-f9a8a3678c25 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:24.579032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3ef33f9-6a28-4bbf-8ed1-f9a8a3678c25 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:24.579558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3ef33f9-6a28-4bbf-8ed1-f9a8a3678c25 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:24.580501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3ef33f9-6a28-4bbf-8ed1-f9a8a3678c25 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:24.581093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3ef33f9-6a28-4bbf-8ed1-f9a8a3678c25 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:24.612384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c3ef33f9-6a28-4bbf-8ed1-f9a8a3678c25 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Jan 15 15:53:24.620483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 370/734] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:53:25.636506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e7a98f02-ee92-4bfc-ad37-98c5f2346389 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:25.637714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e7a98f02-ee92-4bfc-ad37-98c5f2346389 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:25.644045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7a98f02-ee92-4bfc-ad37-98c5f2346389 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:25.644591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7a98f02-ee92-4bfc-ad37-98c5f2346389 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:25.645447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7a98f02-ee92-4bfc-ad37-98c5f2346389 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:25.645977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7a98f02-ee92-4bfc-ad37-98c5f2346389 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:25.679619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e7a98f02-ee92-4bfc-ad37-98c5f2346389 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Jan 15 15:53:25.680204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 365/735] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:26.698533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9fe0f736-816e-46ce-ba65-d3bde6048af7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:26.700028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9fe0f736-816e-46ce-ba65-d3bde6048af7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:26.706610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fe0f736-816e-46ce-ba65-d3bde6048af7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:26.707066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fe0f736-816e-46ce-ba65-d3bde6048af7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:26.707861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fe0f736-816e-46ce-ba65-d3bde6048af7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:26.708361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fe0f736-816e-46ce-ba65-d3bde6048af7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:26.736330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9fe0f736-816e-46ce-ba65-d3bde6048af7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Jan 15 15:53:26.736888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 371/736] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:27.747184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-545068f0-655d-489f-a66c-aa65c4d723f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:27.748444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-545068f0-655d-489f-a66c-aa65c4d723f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:27.754946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-545068f0-655d-489f-a66c-aa65c4d723f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:27.755401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-545068f0-655d-489f-a66c-aa65c4d723f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:27.756207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-545068f0-655d-489f-a66c-aa65c4d723f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:27.756647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-545068f0-655d-489f-a66c-aa65c4d723f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:27.787391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-545068f0-655d-489f-a66c-aa65c4d723f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Jan 15 15:53:27.787949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 366/737] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:28.799524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9a54c7bf-b9c5-4366-820d-e7fee34ba96c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:28.800475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9a54c7bf-b9c5-4366-820d-e7fee34ba96c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:28.806668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9a54c7bf-b9c5-4366-820d-e7fee34ba96c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:28.807114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9a54c7bf-b9c5-4366-820d-e7fee34ba96c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:28.807889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9a54c7bf-b9c5-4366-820d-e7fee34ba96c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:28.808947 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9a54c7bf-b9c5-4366-820d-e7fee34ba96c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:28.836948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9a54c7bf-b9c5-4366-820d-e7fee34ba96c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Jan 15 15:53:28.840167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 372/738] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:29.849639 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-297c68d6-5f66-4efa-a006-713680806580 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:29.850591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-297c68d6-5f66-4efa-a006-713680806580 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:29.857659 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-297c68d6-5f66-4efa-a006-713680806580 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:29.858112 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-297c68d6-5f66-4efa-a006-713680806580 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:29.858889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-297c68d6-5f66-4efa-a006-713680806580 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:29.859327 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-297c68d6-5f66-4efa-a006-713680806580 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:29.887829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-297c68d6-5f66-4efa-a006-713680806580 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Jan 15 15:53:29.888425 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 367/739] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:30.898589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0bf4d018-8e8c-4a35-9816-e989a3c8bcf6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:30.899588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0bf4d018-8e8c-4a35-9816-e989a3c8bcf6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:30.906203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bf4d018-8e8c-4a35-9816-e989a3c8bcf6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:30.906649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bf4d018-8e8c-4a35-9816-e989a3c8bcf6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:30.907421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bf4d018-8e8c-4a35-9816-e989a3c8bcf6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:30.907855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0bf4d018-8e8c-4a35-9816-e989a3c8bcf6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:30.940849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0bf4d018-8e8c-4a35-9816-e989a3c8bcf6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045970 Jan 15 15:53:30.941390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 373/740] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:31.952650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b496491b-e350-43a2-b7fe-b258e072453b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:31.953605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b496491b-e350-43a2-b7fe-b258e072453b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:31.959884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b496491b-e350-43a2-b7fe-b258e072453b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:31.960379 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b496491b-e350-43a2-b7fe-b258e072453b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:31.961190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b496491b-e350-43a2-b7fe-b258e072453b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:31.961634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b496491b-e350-43a2-b7fe-b258e072453b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:31.989890 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b496491b-e350-43a2-b7fe-b258e072453b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041730 Jan 15 15:53:31.990435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 368/741] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:33.001203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c5e560f7-e845-4cd7-b85f-341a89f06e6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:33.002105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c5e560f7-e845-4cd7-b85f-341a89f06e6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:33.007973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5e560f7-e845-4cd7-b85f-341a89f06e6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:33.008451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5e560f7-e845-4cd7-b85f-341a89f06e6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:33.009220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5e560f7-e845-4cd7-b85f-341a89f06e6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:33.009652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5e560f7-e845-4cd7-b85f-341a89f06e6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:33.040104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c5e560f7-e845-4cd7-b85f-341a89f06e6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 Jan 15 15:53:33.040381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 374/742] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:34.050778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-24dbc4f3-3591-4acc-b630-124092052b72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:34.051734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-24dbc4f3-3591-4acc-b630-124092052b72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:34.058136 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-24dbc4f3-3591-4acc-b630-124092052b72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:34.058595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-24dbc4f3-3591-4acc-b630-124092052b72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:34.059388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-24dbc4f3-3591-4acc-b630-124092052b72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:34.059834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-24dbc4f3-3591-4acc-b630-124092052b72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:34.088430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-24dbc4f3-3591-4acc-b630-124092052b72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Jan 15 15:53:34.088993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 369/743] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:35.100101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a7761a5e-b0ef-4a06-b273-5ba70a4998ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:35.101050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a7761a5e-b0ef-4a06-b273-5ba70a4998ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:35.107982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7761a5e-b0ef-4a06-b273-5ba70a4998ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:35.108471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7761a5e-b0ef-4a06-b273-5ba70a4998ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:35.109260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7761a5e-b0ef-4a06-b273-5ba70a4998ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:35.109703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7761a5e-b0ef-4a06-b273-5ba70a4998ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:35.137473 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a7761a5e-b0ef-4a06-b273-5ba70a4998ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041132 Jan 15 15:53:35.138025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 375/744] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:36.148637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f4a439c8-71b9-43fb-b9d1-be4f196ed1af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:36.149537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f4a439c8-71b9-43fb-b9d1-be4f196ed1af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:36.156554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4a439c8-71b9-43fb-b9d1-be4f196ed1af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:36.157047 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4a439c8-71b9-43fb-b9d1-be4f196ed1af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:36.157860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4a439c8-71b9-43fb-b9d1-be4f196ed1af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:36.158298 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4a439c8-71b9-43fb-b9d1-be4f196ed1af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:36.189237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f4a439c8-71b9-43fb-b9d1-be4f196ed1af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Jan 15 15:53:36.189795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 370/745] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:37.199803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cf3274a6-faa4-49c6-9b8e-ace95b7ae76f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:37.200744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cf3274a6-faa4-49c6-9b8e-ace95b7ae76f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:37.206966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cf3274a6-faa4-49c6-9b8e-ace95b7ae76f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:37.207423 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cf3274a6-faa4-49c6-9b8e-ace95b7ae76f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:37.208227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cf3274a6-faa4-49c6-9b8e-ace95b7ae76f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:37.208666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cf3274a6-faa4-49c6-9b8e-ace95b7ae76f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:37.237674 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cf3274a6-faa4-49c6-9b8e-ace95b7ae76f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041572 Jan 15 15:53:37.238224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 376/746] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:38.249137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-535d0d7c-8394-443f-a41d-47bf1d53ad16 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:38.250055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-535d0d7c-8394-443f-a41d-47bf1d53ad16 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:38.256330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-535d0d7c-8394-443f-a41d-47bf1d53ad16 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:38.256788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-535d0d7c-8394-443f-a41d-47bf1d53ad16 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:38.257566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-535d0d7c-8394-443f-a41d-47bf1d53ad16 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:38.258005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-535d0d7c-8394-443f-a41d-47bf1d53ad16 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:38.286301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-535d0d7c-8394-443f-a41d-47bf1d53ad16 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 Jan 15 15:53:38.286839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 371/747] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:39.298332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c0b03433-97d6-4be9-b284-aa4356c5a7e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:39.299162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c0b03433-97d6-4be9-b284-aa4356c5a7e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:39.305372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0b03433-97d6-4be9-b284-aa4356c5a7e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:39.305822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0b03433-97d6-4be9-b284-aa4356c5a7e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:39.306597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0b03433-97d6-4be9-b284-aa4356c5a7e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:39.307034 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0b03433-97d6-4be9-b284-aa4356c5a7e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:39.336212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c0b03433-97d6-4be9-b284-aa4356c5a7e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 Jan 15 15:53:39.336759 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 377/748] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:40.348384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bf97b7b4-b09e-4092-b56b-4868a2219265 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:40.349261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bf97b7b4-b09e-4092-b56b-4868a2219265 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:40.356411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf97b7b4-b09e-4092-b56b-4868a2219265 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:40.356867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf97b7b4-b09e-4092-b56b-4868a2219265 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:40.357673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf97b7b4-b09e-4092-b56b-4868a2219265 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:40.358111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf97b7b4-b09e-4092-b56b-4868a2219265 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:40.386545 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bf97b7b4-b09e-4092-b56b-4868a2219265 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041705 Jan 15 15:53:40.387090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 372/749] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:41.398002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3fd60fcb-27b6-43d3-9518-cc8f15d71dd1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:41.398909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3fd60fcb-27b6-43d3-9518-cc8f15d71dd1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:41.405335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3fd60fcb-27b6-43d3-9518-cc8f15d71dd1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:41.405779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3fd60fcb-27b6-43d3-9518-cc8f15d71dd1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:41.406547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3fd60fcb-27b6-43d3-9518-cc8f15d71dd1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:41.406974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3fd60fcb-27b6-43d3-9518-cc8f15d71dd1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:41.436687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3fd60fcb-27b6-43d3-9518-cc8f15d71dd1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042712 Jan 15 15:53:41.437233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 378/750] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:42.447768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2c34c3cc-7541-4d19-b747-681662e2524c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:42.449583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2c34c3cc-7541-4d19-b747-681662e2524c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:42.455764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2c34c3cc-7541-4d19-b747-681662e2524c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:42.456242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2c34c3cc-7541-4d19-b747-681662e2524c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:42.457015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2c34c3cc-7541-4d19-b747-681662e2524c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:42.457446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2c34c3cc-7541-4d19-b747-681662e2524c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:42.485911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2c34c3cc-7541-4d19-b747-681662e2524c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 Jan 15 15:53:42.486458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 373/751] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:43.496671 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8464656d-78de-4ff4-b8f7-c005e330b0e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:43.497597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8464656d-78de-4ff4-b8f7-c005e330b0e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:43.503739 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8464656d-78de-4ff4-b8f7-c005e330b0e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:43.504285 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8464656d-78de-4ff4-b8f7-c005e330b0e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:43.505069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8464656d-78de-4ff4-b8f7-c005e330b0e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:43.505509 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8464656d-78de-4ff4-b8f7-c005e330b0e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:43.537032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8464656d-78de-4ff4-b8f7-c005e330b0e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Jan 15 15:53:43.537588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 379/752] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:44.549383 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d74e8d9c-9495-4410-981e-3535ec1ef082 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:44.550289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d74e8d9c-9495-4410-981e-3535ec1ef082 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:44.556794 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d74e8d9c-9495-4410-981e-3535ec1ef082 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:44.557242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d74e8d9c-9495-4410-981e-3535ec1ef082 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:44.559015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d74e8d9c-9495-4410-981e-3535ec1ef082 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:44.559450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d74e8d9c-9495-4410-981e-3535ec1ef082 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:44.587042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d74e8d9c-9495-4410-981e-3535ec1ef082 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Jan 15 15:53:44.587583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 374/753] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:45.597781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-285ede49-cf0c-4a52-822c-f9a50dbdea54 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:45.598705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-285ede49-cf0c-4a52-822c-f9a50dbdea54 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:45.605048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-285ede49-cf0c-4a52-822c-f9a50dbdea54 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:45.605501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-285ede49-cf0c-4a52-822c-f9a50dbdea54 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:45.606286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-285ede49-cf0c-4a52-822c-f9a50dbdea54 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:45.606724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-285ede49-cf0c-4a52-822c-f9a50dbdea54 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:45.635129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-285ede49-cf0c-4a52-822c-f9a50dbdea54 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041121 Jan 15 15:53:45.636335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 380/754] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:46.646923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d3bf4ad7-e7ef-4cba-a6b0-c1ba07b50414 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:46.648162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d3bf4ad7-e7ef-4cba-a6b0-c1ba07b50414 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:46.654950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3bf4ad7-e7ef-4cba-a6b0-c1ba07b50414 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:46.655402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3bf4ad7-e7ef-4cba-a6b0-c1ba07b50414 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:46.656205 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3bf4ad7-e7ef-4cba-a6b0-c1ba07b50414 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:46.656640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3bf4ad7-e7ef-4cba-a6b0-c1ba07b50414 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:46.685605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d3bf4ad7-e7ef-4cba-a6b0-c1ba07b50414 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042410 Jan 15 15:53:46.686143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 375/755] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:47.696807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a6787d0d-42fe-48a8-892a-16556f092e23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:47.697719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a6787d0d-42fe-48a8-892a-16556f092e23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:47.703954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6787d0d-42fe-48a8-892a-16556f092e23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:47.704547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6787d0d-42fe-48a8-892a-16556f092e23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:47.705319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6787d0d-42fe-48a8-892a-16556f092e23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:47.705752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6787d0d-42fe-48a8-892a-16556f092e23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:47.734953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a6787d0d-42fe-48a8-892a-16556f092e23 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041840 Jan 15 15:53:47.735493 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 381/756] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:48.746429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-42c91fba-fa24-4c31-9bf4-61d76fd33187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:48.747272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-42c91fba-fa24-4c31-9bf4-61d76fd33187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:48.753502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-42c91fba-fa24-4c31-9bf4-61d76fd33187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:48.753950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-42c91fba-fa24-4c31-9bf4-61d76fd33187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:48.754718 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-42c91fba-fa24-4c31-9bf4-61d76fd33187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:48.755151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-42c91fba-fa24-4c31-9bf4-61d76fd33187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:48.784049 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-42c91fba-fa24-4c31-9bf4-61d76fd33187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 Jan 15 15:53:48.784632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 376/757] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:49.795603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1fd407f6-8a0d-4faf-9cc6-2dc5ba877c02 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:49.796544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1fd407f6-8a0d-4faf-9cc6-2dc5ba877c02 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:49.802773 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1fd407f6-8a0d-4faf-9cc6-2dc5ba877c02 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:49.803225 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1fd407f6-8a0d-4faf-9cc6-2dc5ba877c02 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:49.804012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1fd407f6-8a0d-4faf-9cc6-2dc5ba877c02 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:49.804480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1fd407f6-8a0d-4faf-9cc6-2dc5ba877c02 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:49.837967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1fd407f6-8a0d-4faf-9cc6-2dc5ba877c02 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Jan 15 15:53:49.838398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 382/758] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:50.849235 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bff2f59c-b2ad-47a6-b047-8d453d5aee7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:50.850151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bff2f59c-b2ad-47a6-b047-8d453d5aee7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:50.856794 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bff2f59c-b2ad-47a6-b047-8d453d5aee7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:50.857246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bff2f59c-b2ad-47a6-b047-8d453d5aee7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:50.858067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bff2f59c-b2ad-47a6-b047-8d453d5aee7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:50.858508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bff2f59c-b2ad-47a6-b047-8d453d5aee7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:50.888028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bff2f59c-b2ad-47a6-b047-8d453d5aee7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042641 Jan 15 15:53:50.888634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 377/759] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:51.899328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0a0637b6-e46f-4573-a5e6-c1fb4c008e29 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:51.900265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0a0637b6-e46f-4573-a5e6-c1fb4c008e29 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:51.906579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a0637b6-e46f-4573-a5e6-c1fb4c008e29 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:51.907036 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a0637b6-e46f-4573-a5e6-c1fb4c008e29 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:51.907810 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a0637b6-e46f-4573-a5e6-c1fb4c008e29 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:51.908286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0a0637b6-e46f-4573-a5e6-c1fb4c008e29 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:51.937476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0a0637b6-e46f-4573-a5e6-c1fb4c008e29 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Jan 15 15:53:51.938032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 383/760] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:52.948407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f6761a02-d5db-4fc4-87bf-82e43aa8afc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:52.949359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f6761a02-d5db-4fc4-87bf-82e43aa8afc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:52.955581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6761a02-d5db-4fc4-87bf-82e43aa8afc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:52.956037 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6761a02-d5db-4fc4-87bf-82e43aa8afc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:52.956858 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6761a02-d5db-4fc4-87bf-82e43aa8afc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:52.957306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6761a02-d5db-4fc4-87bf-82e43aa8afc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:52.986975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f6761a02-d5db-4fc4-87bf-82e43aa8afc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Jan 15 15:53:52.987540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 378/761] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:53.997972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cd38041d-309b-423b-a764-c7bf0752c3e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:53.998889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cd38041d-309b-423b-a764-c7bf0752c3e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:54.005160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd38041d-309b-423b-a764-c7bf0752c3e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:54.005610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd38041d-309b-423b-a764-c7bf0752c3e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:54.006386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd38041d-309b-423b-a764-c7bf0752c3e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:54.006824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd38041d-309b-423b-a764-c7bf0752c3e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:54.036623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cd38041d-309b-423b-a764-c7bf0752c3e6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 Jan 15 15:53:54.037423 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 384/762] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:55.047817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bac526f6-067b-4033-8744-ec7ef833c33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:55.048769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bac526f6-067b-4033-8744-ec7ef833c33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:55.054991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bac526f6-067b-4033-8744-ec7ef833c33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:55.055442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bac526f6-067b-4033-8744-ec7ef833c33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:55.056263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bac526f6-067b-4033-8744-ec7ef833c33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:55.056701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bac526f6-067b-4033-8744-ec7ef833c33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:55.086463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bac526f6-067b-4033-8744-ec7ef833c33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Jan 15 15:53:55.087027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 379/763] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:56.097717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b02dba2e-74b4-4149-9152-cab523a0f56a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:56.098624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b02dba2e-74b4-4149-9152-cab523a0f56a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:56.106055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b02dba2e-74b4-4149-9152-cab523a0f56a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:56.106512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b02dba2e-74b4-4149-9152-cab523a0f56a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:56.107299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b02dba2e-74b4-4149-9152-cab523a0f56a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:56.107731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b02dba2e-74b4-4149-9152-cab523a0f56a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:56.137661 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b02dba2e-74b4-4149-9152-cab523a0f56a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Jan 15 15:53:56.138231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 385/764] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:57.148843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-56a5218d-f22d-44e7-9743-ad9bb7bd646c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:57.149762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-56a5218d-f22d-44e7-9743-ad9bb7bd646c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:57.156685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-56a5218d-f22d-44e7-9743-ad9bb7bd646c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:57.157143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-56a5218d-f22d-44e7-9743-ad9bb7bd646c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:57.157928 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-56a5218d-f22d-44e7-9743-ad9bb7bd646c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:57.158369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-56a5218d-f22d-44e7-9743-ad9bb7bd646c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:57.188269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-56a5218d-f22d-44e7-9743-ad9bb7bd646c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Jan 15 15:53:57.188826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 380/765] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:58.199732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7398801d-57b9-432c-be87-08ae064f2793 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:58.200705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7398801d-57b9-432c-be87-08ae064f2793 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:58.206729 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7398801d-57b9-432c-be87-08ae064f2793 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:58.207177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7398801d-57b9-432c-be87-08ae064f2793 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:58.207957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7398801d-57b9-432c-be87-08ae064f2793 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:58.208421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7398801d-57b9-432c-be87-08ae064f2793 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:58.238151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7398801d-57b9-432c-be87-08ae064f2793 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042564 Jan 15 15:53:58.238866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 386/766] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:53:59.248532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ddfaacec-97c3-43fc-b309-9cf6c8fab26b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:53:59.249458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ddfaacec-97c3-43fc-b309-9cf6c8fab26b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:53:59.255525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ddfaacec-97c3-43fc-b309-9cf6c8fab26b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:59.255975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ddfaacec-97c3-43fc-b309-9cf6c8fab26b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:59.256802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ddfaacec-97c3-43fc-b309-9cf6c8fab26b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:53:59.257239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ddfaacec-97c3-43fc-b309-9cf6c8fab26b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:53:59.287479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ddfaacec-97c3-43fc-b309-9cf6c8fab26b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Jan 15 15:53:59.288305 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 381/767] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:53:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:00.298415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ed0cd642-f3df-4113-9fcf-eb10ece20732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:00.299325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ed0cd642-f3df-4113-9fcf-eb10ece20732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:00.305566 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed0cd642-f3df-4113-9fcf-eb10ece20732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:00.306018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed0cd642-f3df-4113-9fcf-eb10ece20732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:00.306795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed0cd642-f3df-4113-9fcf-eb10ece20732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:00.307242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed0cd642-f3df-4113-9fcf-eb10ece20732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:00.336112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ed0cd642-f3df-4113-9fcf-eb10ece20732 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041306 Jan 15 15:54:00.336937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 387/768] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:01.348315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6d4e94f0-1be6-4003-a063-dfa06315c19b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:01.349286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6d4e94f0-1be6-4003-a063-dfa06315c19b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:01.356153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d4e94f0-1be6-4003-a063-dfa06315c19b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:01.356620 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d4e94f0-1be6-4003-a063-dfa06315c19b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:01.357411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d4e94f0-1be6-4003-a063-dfa06315c19b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:01.357851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d4e94f0-1be6-4003-a063-dfa06315c19b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:01.387666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6d4e94f0-1be6-4003-a063-dfa06315c19b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043090 Jan 15 15:54:01.388287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 382/769] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:02.398843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-05b7349d-123a-43bf-b1de-720ba4055912 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:02.399782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-05b7349d-123a-43bf-b1de-720ba4055912 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:02.406019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05b7349d-123a-43bf-b1de-720ba4055912 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:02.406473 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05b7349d-123a-43bf-b1de-720ba4055912 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:02.407258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05b7349d-123a-43bf-b1de-720ba4055912 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:02.407692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05b7349d-123a-43bf-b1de-720ba4055912 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:02.437895 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-05b7349d-123a-43bf-b1de-720ba4055912 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042725 Jan 15 15:54:02.438470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 388/770] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:03.450102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-83063593-7b0c-4bfa-b39e-4d97ea666260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:03.451015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-83063593-7b0c-4bfa-b39e-4d97ea666260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:03.457158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83063593-7b0c-4bfa-b39e-4d97ea666260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:03.457608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83063593-7b0c-4bfa-b39e-4d97ea666260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:03.458386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83063593-7b0c-4bfa-b39e-4d97ea666260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:03.458822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-83063593-7b0c-4bfa-b39e-4d97ea666260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:03.488022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-83063593-7b0c-4bfa-b39e-4d97ea666260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042396 Jan 15 15:54:03.488898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 383/771] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:04.499263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-37122a07-a13e-4ed7-8c59-3e2baae72b6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:04.500193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-37122a07-a13e-4ed7-8c59-3e2baae72b6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:04.506242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37122a07-a13e-4ed7-8c59-3e2baae72b6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:04.506790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37122a07-a13e-4ed7-8c59-3e2baae72b6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:04.507563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37122a07-a13e-4ed7-8c59-3e2baae72b6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:04.508243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37122a07-a13e-4ed7-8c59-3e2baae72b6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:04.540242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-37122a07-a13e-4ed7-8c59-3e2baae72b6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Jan 15 15:54:04.542081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 389/772] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:05.550630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ab462fb7-128e-4f04-bf12-9d2f77a4e392 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:05.551567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ab462fb7-128e-4f04-bf12-9d2f77a4e392 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:05.558964 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab462fb7-128e-4f04-bf12-9d2f77a4e392 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:05.559500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab462fb7-128e-4f04-bf12-9d2f77a4e392 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:05.560521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab462fb7-128e-4f04-bf12-9d2f77a4e392 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:05.560995 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab462fb7-128e-4f04-bf12-9d2f77a4e392 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:05.591398 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ab462fb7-128e-4f04-bf12-9d2f77a4e392 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Jan 15 15:54:05.592232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 384/773] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:06.609315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8ba8d922-2953-42d6-a006-360d51f1a015 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:06.610213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ba8d922-2953-42d6-a006-360d51f1a015 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:06.616554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba8d922-2953-42d6-a006-360d51f1a015 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:06.617004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba8d922-2953-42d6-a006-360d51f1a015 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:06.617781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba8d922-2953-42d6-a006-360d51f1a015 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:06.618211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba8d922-2953-42d6-a006-360d51f1a015 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:06.648525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8ba8d922-2953-42d6-a006-360d51f1a015 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Jan 15 15:54:06.649077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 390/774] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:07.659692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d4d4326c-217f-4bf8-a135-16ddb4611a5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:07.660633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d4d4326c-217f-4bf8-a135-16ddb4611a5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:07.667315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4d4326c-217f-4bf8-a135-16ddb4611a5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:07.667705 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4d4326c-217f-4bf8-a135-16ddb4611a5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:07.668503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4d4326c-217f-4bf8-a135-16ddb4611a5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:07.668933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4d4326c-217f-4bf8-a135-16ddb4611a5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:07.698044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d4d4326c-217f-4bf8-a135-16ddb4611a5a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Jan 15 15:54:07.698591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 385/775] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:08.709079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ef58732-c293-4731-adf6-a148aad0ce6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:08.709983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ef58732-c293-4731-adf6-a148aad0ce6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:08.716875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef58732-c293-4731-adf6-a148aad0ce6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:08.717328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef58732-c293-4731-adf6-a148aad0ce6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:08.718143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef58732-c293-4731-adf6-a148aad0ce6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:08.718582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef58732-c293-4731-adf6-a148aad0ce6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:08.747633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ef58732-c293-4731-adf6-a148aad0ce6e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042263 Jan 15 15:54:08.748201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 391/776] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:09.758628 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8888b6c9-b67f-4bc1-b552-6d26d1f8a442 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:09.760466 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8888b6c9-b67f-4bc1-b552-6d26d1f8a442 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:09.766551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8888b6c9-b67f-4bc1-b552-6d26d1f8a442 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:09.767004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8888b6c9-b67f-4bc1-b552-6d26d1f8a442 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:09.767792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8888b6c9-b67f-4bc1-b552-6d26d1f8a442 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:09.768269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8888b6c9-b67f-4bc1-b552-6d26d1f8a442 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:09.798665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8888b6c9-b67f-4bc1-b552-6d26d1f8a442 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043784 Jan 15 15:54:09.799209 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 386/777] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:10.809887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6d6de58e-9c34-45a1-b39c-8a9863fc7abe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:10.810793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6d6de58e-9c34-45a1-b39c-8a9863fc7abe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:10.816929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d6de58e-9c34-45a1-b39c-8a9863fc7abe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:10.817356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d6de58e-9c34-45a1-b39c-8a9863fc7abe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:10.818121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d6de58e-9c34-45a1-b39c-8a9863fc7abe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:10.818554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d6de58e-9c34-45a1-b39c-8a9863fc7abe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:10.847909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6d6de58e-9c34-45a1-b39c-8a9863fc7abe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Jan 15 15:54:10.848482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 392/778] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:11.859609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2a392321-1cd8-4759-8f68-cd530a8092c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:11.860552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2a392321-1cd8-4759-8f68-cd530a8092c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:11.866820 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2a392321-1cd8-4759-8f68-cd530a8092c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:11.867272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2a392321-1cd8-4759-8f68-cd530a8092c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:11.868050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2a392321-1cd8-4759-8f68-cd530a8092c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:11.868542 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2a392321-1cd8-4759-8f68-cd530a8092c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:11.896651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2a392321-1cd8-4759-8f68-cd530a8092c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Jan 15 15:54:11.897196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 387/779] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:12.912366 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c3a64803-f386-41d6-89b2-96fa4c1a6fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:12.912366 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c3a64803-f386-41d6-89b2-96fa4c1a6fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:12.917018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3a64803-f386-41d6-89b2-96fa4c1a6fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:12.917402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3a64803-f386-41d6-89b2-96fa4c1a6fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:12.918179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3a64803-f386-41d6-89b2-96fa4c1a6fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:12.918614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c3a64803-f386-41d6-89b2-96fa4c1a6fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:12.947527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c3a64803-f386-41d6-89b2-96fa4c1a6fe8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Jan 15 15:54:12.948085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 393/780] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:13.958539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-77d8264f-d628-43b2-b612-0328a757456a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:13.959449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-77d8264f-d628-43b2-b612-0328a757456a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:13.965955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77d8264f-d628-43b2-b612-0328a757456a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:13.966447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77d8264f-d628-43b2-b612-0328a757456a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:13.967231 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77d8264f-d628-43b2-b612-0328a757456a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:13.967673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77d8264f-d628-43b2-b612-0328a757456a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:13.996724 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-77d8264f-d628-43b2-b612-0328a757456a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041856 Jan 15 15:54:13.997291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 388/781] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:15.007791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2b81365f-ec73-409b-aadf-93c1c66ac7c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:15.008755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2b81365f-ec73-409b-aadf-93c1c66ac7c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:15.015721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b81365f-ec73-409b-aadf-93c1c66ac7c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:15.016204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b81365f-ec73-409b-aadf-93c1c66ac7c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:15.016994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b81365f-ec73-409b-aadf-93c1c66ac7c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:15.017437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b81365f-ec73-409b-aadf-93c1c66ac7c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:15.047492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2b81365f-ec73-409b-aadf-93c1c66ac7c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Jan 15 15:54:15.048049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 394/782] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:16.058636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-700dc035-f219-4a0a-9148-fc2f6e355d6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:16.059650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-700dc035-f219-4a0a-9148-fc2f6e355d6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:16.065834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-700dc035-f219-4a0a-9148-fc2f6e355d6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:16.066281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-700dc035-f219-4a0a-9148-fc2f6e355d6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:16.067059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-700dc035-f219-4a0a-9148-fc2f6e355d6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:16.067493 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-700dc035-f219-4a0a-9148-fc2f6e355d6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:16.096019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-700dc035-f219-4a0a-9148-fc2f6e355d6f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Jan 15 15:54:16.096606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 389/783] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:17.107811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-17b168c9-c901-42bf-a966-a43b6a220b9d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:17.108781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-17b168c9-c901-42bf-a966-a43b6a220b9d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:17.116025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-17b168c9-c901-42bf-a966-a43b6a220b9d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:17.116515 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-17b168c9-c901-42bf-a966-a43b6a220b9d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:17.117304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-17b168c9-c901-42bf-a966-a43b6a220b9d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:17.117745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-17b168c9-c901-42bf-a966-a43b6a220b9d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:17.147320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-17b168c9-c901-42bf-a966-a43b6a220b9d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Jan 15 15:54:17.147877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 395/784] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:18.158716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-03382503-2d6e-4a8f-9795-ae0c4e87c253 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:18.159625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-03382503-2d6e-4a8f-9795-ae0c4e87c253 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:18.166102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03382503-2d6e-4a8f-9795-ae0c4e87c253 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:18.166556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03382503-2d6e-4a8f-9795-ae0c4e87c253 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:18.167323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03382503-2d6e-4a8f-9795-ae0c4e87c253 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:18.167756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-03382503-2d6e-4a8f-9795-ae0c4e87c253 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:18.197338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-03382503-2d6e-4a8f-9795-ae0c4e87c253 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 Jan 15 15:54:18.197891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 390/785] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:19.208786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-71c40196-daa6-4c08-b637-cf61c55908e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:19.209691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-71c40196-daa6-4c08-b637-cf61c55908e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:19.216720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71c40196-daa6-4c08-b637-cf61c55908e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:19.217166 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71c40196-daa6-4c08-b637-cf61c55908e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:19.217938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71c40196-daa6-4c08-b637-cf61c55908e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:19.218371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71c40196-daa6-4c08-b637-cf61c55908e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:19.248360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-71c40196-daa6-4c08-b637-cf61c55908e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Jan 15 15:54:19.249032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 396/786] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:20.259078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-30f35023-9d95-439d-9f43-dd474b4fe17e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:20.260679 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-30f35023-9d95-439d-9f43-dd474b4fe17e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:20.266832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30f35023-9d95-439d-9f43-dd474b4fe17e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:20.267323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30f35023-9d95-439d-9f43-dd474b4fe17e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:20.268110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30f35023-9d95-439d-9f43-dd474b4fe17e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:20.268580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30f35023-9d95-439d-9f43-dd474b4fe17e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:20.298217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-30f35023-9d95-439d-9f43-dd474b4fe17e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Jan 15 15:54:20.298763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 391/787] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:21.309769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-34abf195-2659-4cfc-914a-d11508fb270d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:21.310627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-34abf195-2659-4cfc-914a-d11508fb270d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:21.316805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34abf195-2659-4cfc-914a-d11508fb270d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:21.317246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34abf195-2659-4cfc-914a-d11508fb270d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:21.318017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34abf195-2659-4cfc-914a-d11508fb270d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:21.318449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34abf195-2659-4cfc-914a-d11508fb270d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:21.347190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-34abf195-2659-4cfc-914a-d11508fb270d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 Jan 15 15:54:21.347732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 397/788] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:22.358215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e01e9fe2-3b44-4b33-a88b-9aab8c8d59a3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:22.359169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e01e9fe2-3b44-4b33-a88b-9aab8c8d59a3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:22.365442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e01e9fe2-3b44-4b33-a88b-9aab8c8d59a3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:22.372125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e01e9fe2-3b44-4b33-a88b-9aab8c8d59a3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:22.372125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e01e9fe2-3b44-4b33-a88b-9aab8c8d59a3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:22.372125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e01e9fe2-3b44-4b33-a88b-9aab8c8d59a3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:22.396590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e01e9fe2-3b44-4b33-a88b-9aab8c8d59a3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042022 Jan 15 15:54:22.397142 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 392/789] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:23.408745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2b95ebd2-ad68-497d-91b0-faf76a2a0187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:23.409862 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2b95ebd2-ad68-497d-91b0-faf76a2a0187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:23.417200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b95ebd2-ad68-497d-91b0-faf76a2a0187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:23.417650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b95ebd2-ad68-497d-91b0-faf76a2a0187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:23.418468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b95ebd2-ad68-497d-91b0-faf76a2a0187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:23.419000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2b95ebd2-ad68-497d-91b0-faf76a2a0187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:23.451106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2b95ebd2-ad68-497d-91b0-faf76a2a0187 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Jan 15 15:54:23.451661 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 398/790] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:24.463307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4b7f150b-1114-4a79-a83d-e5a31b65130e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:24.464269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4b7f150b-1114-4a79-a83d-e5a31b65130e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:24.470429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b7f150b-1114-4a79-a83d-e5a31b65130e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:24.470878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b7f150b-1114-4a79-a83d-e5a31b65130e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:24.471656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b7f150b-1114-4a79-a83d-e5a31b65130e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:24.472088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b7f150b-1114-4a79-a83d-e5a31b65130e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:24.500183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4b7f150b-1114-4a79-a83d-e5a31b65130e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Jan 15 15:54:24.500721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 393/791] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:25.511233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d989c328-6f1f-4fbd-bba4-d92a9d737d87 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:25.512313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d989c328-6f1f-4fbd-bba4-d92a9d737d87 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:25.518565 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d989c328-6f1f-4fbd-bba4-d92a9d737d87 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:25.519019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d989c328-6f1f-4fbd-bba4-d92a9d737d87 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:25.519803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d989c328-6f1f-4fbd-bba4-d92a9d737d87 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:25.520275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d989c328-6f1f-4fbd-bba4-d92a9d737d87 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:25.549490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d989c328-6f1f-4fbd-bba4-d92a9d737d87 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042632 Jan 15 15:54:25.550048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 399/792] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:26.560701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-482f35db-05e2-443d-b570-9384fd98e7dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:26.561538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-482f35db-05e2-443d-b570-9384fd98e7dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:26.567702 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-482f35db-05e2-443d-b570-9384fd98e7dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:26.568164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-482f35db-05e2-443d-b570-9384fd98e7dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:26.568958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-482f35db-05e2-443d-b570-9384fd98e7dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:26.569396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-482f35db-05e2-443d-b570-9384fd98e7dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:26.599776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-482f35db-05e2-443d-b570-9384fd98e7dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042777 Jan 15 15:54:26.600366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 394/793] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:54:27.610995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0e993eb6-354f-460b-8ad4-00bb55faed46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:27.611824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0e993eb6-354f-460b-8ad4-00bb55faed46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:27.618073 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e993eb6-354f-460b-8ad4-00bb55faed46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:27.618528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e993eb6-354f-460b-8ad4-00bb55faed46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:27.619298 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e993eb6-354f-460b-8ad4-00bb55faed46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:27.619732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e993eb6-354f-460b-8ad4-00bb55faed46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:27.647709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0e993eb6-354f-460b-8ad4-00bb55faed46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 Jan 15 15:54:27.648292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 400/794] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:28.659616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cf2058f7-a626-485e-9fd7-6ef4d755780b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:28.660623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cf2058f7-a626-485e-9fd7-6ef4d755780b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:28.667919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf2058f7-a626-485e-9fd7-6ef4d755780b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:28.668414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf2058f7-a626-485e-9fd7-6ef4d755780b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:28.669217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf2058f7-a626-485e-9fd7-6ef4d755780b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:28.669663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cf2058f7-a626-485e-9fd7-6ef4d755780b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:28.699382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cf2058f7-a626-485e-9fd7-6ef4d755780b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Jan 15 15:54:28.700026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 395/795] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:29.710306 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d99b2135-c6b4-4516-8499-dc5efd26d98d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:29.711218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d99b2135-c6b4-4516-8499-dc5efd26d98d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:29.717612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d99b2135-c6b4-4516-8499-dc5efd26d98d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:29.718059 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d99b2135-c6b4-4516-8499-dc5efd26d98d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:29.718839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d99b2135-c6b4-4516-8499-dc5efd26d98d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:29.719271 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d99b2135-c6b4-4516-8499-dc5efd26d98d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:29.748649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d99b2135-c6b4-4516-8499-dc5efd26d98d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 Jan 15 15:54:29.749221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 401/796] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:30.759754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-16f5712a-3fd2-40b4-ae6d-94573be04aa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:30.761295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-16f5712a-3fd2-40b4-ae6d-94573be04aa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:30.767604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16f5712a-3fd2-40b4-ae6d-94573be04aa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:30.768067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16f5712a-3fd2-40b4-ae6d-94573be04aa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:30.768881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16f5712a-3fd2-40b4-ae6d-94573be04aa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:30.769306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16f5712a-3fd2-40b4-ae6d-94573be04aa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:30.798822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-16f5712a-3fd2-40b4-ae6d-94573be04aa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Jan 15 15:54:30.799390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 396/797] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:31.810175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-99ae0bb4-52fc-4d4f-92ee-ae9a0f01a21a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:31.811090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-99ae0bb4-52fc-4d4f-92ee-ae9a0f01a21a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:31.817345 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99ae0bb4-52fc-4d4f-92ee-ae9a0f01a21a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:31.817795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99ae0bb4-52fc-4d4f-92ee-ae9a0f01a21a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:31.818566 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99ae0bb4-52fc-4d4f-92ee-ae9a0f01a21a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:31.819001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99ae0bb4-52fc-4d4f-92ee-ae9a0f01a21a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:31.850436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-99ae0bb4-52fc-4d4f-92ee-ae9a0f01a21a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044112 Jan 15 15:54:31.851004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 402/798] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:32.862249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9a9e6487-2bf6-4e7f-9a40-07cc92c054a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:32.863171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9a9e6487-2bf6-4e7f-9a40-07cc92c054a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:32.870082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a9e6487-2bf6-4e7f-9a40-07cc92c054a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:32.870540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a9e6487-2bf6-4e7f-9a40-07cc92c054a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:32.871328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a9e6487-2bf6-4e7f-9a40-07cc92c054a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:32.871771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a9e6487-2bf6-4e7f-9a40-07cc92c054a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:32.901019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9a9e6487-2bf6-4e7f-9a40-07cc92c054a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 Jan 15 15:54:32.901788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 397/799] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:33.912438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6dd399b8-e979-4e20-a872-ecaeb4e8ffca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:33.913343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6dd399b8-e979-4e20-a872-ecaeb4e8ffca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:33.919264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd399b8-e979-4e20-a872-ecaeb4e8ffca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:33.919717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd399b8-e979-4e20-a872-ecaeb4e8ffca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:33.920512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd399b8-e979-4e20-a872-ecaeb4e8ffca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:33.920946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd399b8-e979-4e20-a872-ecaeb4e8ffca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:33.951601 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6dd399b8-e979-4e20-a872-ecaeb4e8ffca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Jan 15 15:54:33.952172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 403/800] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:34.963375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-14c6512f-e6b3-4d14-9dd6-ff7595f13683 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:34.964319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-14c6512f-e6b3-4d14-9dd6-ff7595f13683 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:34.970627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c6512f-e6b3-4d14-9dd6-ff7595f13683 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:34.971086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c6512f-e6b3-4d14-9dd6-ff7595f13683 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:34.971868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c6512f-e6b3-4d14-9dd6-ff7595f13683 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:34.972329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-14c6512f-e6b3-4d14-9dd6-ff7595f13683 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:35.001771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-14c6512f-e6b3-4d14-9dd6-ff7595f13683 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Jan 15 15:54:35.002489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 398/801] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:36.012453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-602cf10b-81d6-451c-8c64-422ec6e45808 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:36.013398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-602cf10b-81d6-451c-8c64-422ec6e45808 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:36.019685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-602cf10b-81d6-451c-8c64-422ec6e45808 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:36.020150 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-602cf10b-81d6-451c-8c64-422ec6e45808 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:36.020941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-602cf10b-81d6-451c-8c64-422ec6e45808 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:36.021375 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-602cf10b-81d6-451c-8c64-422ec6e45808 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:36.051922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-602cf10b-81d6-451c-8c64-422ec6e45808 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 Jan 15 15:54:36.051922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 404/802] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:37.062437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-63a1793c-6487-42f2-a0be-fcf375838c36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:37.063339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-63a1793c-6487-42f2-a0be-fcf375838c36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:37.069621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63a1793c-6487-42f2-a0be-fcf375838c36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:37.070082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63a1793c-6487-42f2-a0be-fcf375838c36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:37.070896 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63a1793c-6487-42f2-a0be-fcf375838c36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:37.071334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63a1793c-6487-42f2-a0be-fcf375838c36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:37.100705 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-63a1793c-6487-42f2-a0be-fcf375838c36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041985 Jan 15 15:54:37.101438 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 399/803] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:54:38.112480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c6ce82d2-9c14-4754-84b0-cd423aa9fec2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:38.113398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c6ce82d2-9c14-4754-84b0-cd423aa9fec2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:38.119741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6ce82d2-9c14-4754-84b0-cd423aa9fec2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:38.120219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6ce82d2-9c14-4754-84b0-cd423aa9fec2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:38.121104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6ce82d2-9c14-4754-84b0-cd423aa9fec2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:38.121641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6ce82d2-9c14-4754-84b0-cd423aa9fec2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:38.149920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c6ce82d2-9c14-4754-84b0-cd423aa9fec2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Jan 15 15:54:38.151273 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 405/804] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:39.161168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8abc31ae-2abb-4561-8ce2-3fa98e3dd831 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:39.162369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8abc31ae-2abb-4561-8ce2-3fa98e3dd831 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:39.169015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8abc31ae-2abb-4561-8ce2-3fa98e3dd831 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:39.169471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8abc31ae-2abb-4561-8ce2-3fa98e3dd831 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:39.170253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8abc31ae-2abb-4561-8ce2-3fa98e3dd831 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:39.170865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8abc31ae-2abb-4561-8ce2-3fa98e3dd831 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:39.200083 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8abc31ae-2abb-4561-8ce2-3fa98e3dd831 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042455 Jan 15 15:54:39.200756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 400/805] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:40.210650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-508225fa-3d2f-4597-853b-37b5253d4854 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:40.211566 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-508225fa-3d2f-4597-853b-37b5253d4854 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:40.218129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-508225fa-3d2f-4597-853b-37b5253d4854 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:40.218580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-508225fa-3d2f-4597-853b-37b5253d4854 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:40.221953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-508225fa-3d2f-4597-853b-37b5253d4854 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:40.221953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-508225fa-3d2f-4597-853b-37b5253d4854 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:40.249630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-508225fa-3d2f-4597-853b-37b5253d4854 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Jan 15 15:54:40.250202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 406/806] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:41.264865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f281f946-8523-4323-99bc-49606087f4ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:41.265776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f281f946-8523-4323-99bc-49606087f4ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:41.272404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f281f946-8523-4323-99bc-49606087f4ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:41.272854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f281f946-8523-4323-99bc-49606087f4ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:41.273633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f281f946-8523-4323-99bc-49606087f4ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:41.274071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f281f946-8523-4323-99bc-49606087f4ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:41.304487 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f281f946-8523-4323-99bc-49606087f4ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Jan 15 15:54:41.305045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 401/807] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:42.315005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-677d45aa-20b0-469f-9aaf-1c72d1e8e37e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:42.315923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-677d45aa-20b0-469f-9aaf-1c72d1e8e37e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:42.322608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-677d45aa-20b0-469f-9aaf-1c72d1e8e37e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:42.323101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-677d45aa-20b0-469f-9aaf-1c72d1e8e37e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:42.323942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-677d45aa-20b0-469f-9aaf-1c72d1e8e37e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:42.324415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-677d45aa-20b0-469f-9aaf-1c72d1e8e37e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:42.354860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-677d45aa-20b0-469f-9aaf-1c72d1e8e37e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 Jan 15 15:54:42.355403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 407/808] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:43.366042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b414e75f-8368-4efd-9b63-5235cf8a9aa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:43.367069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b414e75f-8368-4efd-9b63-5235cf8a9aa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:43.374267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b414e75f-8368-4efd-9b63-5235cf8a9aa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:43.376360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b414e75f-8368-4efd-9b63-5235cf8a9aa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:43.376360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b414e75f-8368-4efd-9b63-5235cf8a9aa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:43.376360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b414e75f-8368-4efd-9b63-5235cf8a9aa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:43.405736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b414e75f-8368-4efd-9b63-5235cf8a9aa9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043408 Jan 15 15:54:43.406296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 402/809] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:44.418942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5b689bb7-de03-4445-902b-d556e2b5b14d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:44.419904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5b689bb7-de03-4445-902b-d556e2b5b14d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:44.426618 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b689bb7-de03-4445-902b-d556e2b5b14d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:44.427070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b689bb7-de03-4445-902b-d556e2b5b14d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:44.427854 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b689bb7-de03-4445-902b-d556e2b5b14d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:44.428311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b689bb7-de03-4445-902b-d556e2b5b14d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:44.458506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5b689bb7-de03-4445-902b-d556e2b5b14d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Jan 15 15:54:44.459060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 408/810] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:45.471236 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f8d34c7a-d527-41fa-ab7d-61bc31ab22d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:45.472190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f8d34c7a-d527-41fa-ab7d-61bc31ab22d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:45.482356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f8d34c7a-d527-41fa-ab7d-61bc31ab22d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:45.485046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f8d34c7a-d527-41fa-ab7d-61bc31ab22d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:45.485046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f8d34c7a-d527-41fa-ab7d-61bc31ab22d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:45.485046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f8d34c7a-d527-41fa-ab7d-61bc31ab22d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:45.513671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f8d34c7a-d527-41fa-ab7d-61bc31ab22d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Jan 15 15:54:45.514242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 403/811] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:46.524901 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2490a4a9-30a0-4a56-afaf-c9005dfe3ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:46.525836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2490a4a9-30a0-4a56-afaf-c9005dfe3ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:46.532128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2490a4a9-30a0-4a56-afaf-c9005dfe3ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:46.532609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2490a4a9-30a0-4a56-afaf-c9005dfe3ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:46.533392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2490a4a9-30a0-4a56-afaf-c9005dfe3ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:46.533833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2490a4a9-30a0-4a56-afaf-c9005dfe3ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:46.564241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2490a4a9-30a0-4a56-afaf-c9005dfe3ba7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Jan 15 15:54:46.564809 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 409/812] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:47.575320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e019869c-e25d-4c42-bacf-f4395fdb35a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:47.576328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e019869c-e25d-4c42-bacf-f4395fdb35a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:47.582658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e019869c-e25d-4c42-bacf-f4395fdb35a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:47.583142 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e019869c-e25d-4c42-bacf-f4395fdb35a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:47.583938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e019869c-e25d-4c42-bacf-f4395fdb35a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:47.584407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e019869c-e25d-4c42-bacf-f4395fdb35a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:47.614184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e019869c-e25d-4c42-bacf-f4395fdb35a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Jan 15 15:54:47.614740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 404/813] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:48.625541 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dda057c2-72ff-44c4-8929-e4c1ed3f5f1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:48.626583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dda057c2-72ff-44c4-8929-e4c1ed3f5f1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:48.633301 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda057c2-72ff-44c4-8929-e4c1ed3f5f1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:48.633833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda057c2-72ff-44c4-8929-e4c1ed3f5f1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:48.635277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda057c2-72ff-44c4-8929-e4c1ed3f5f1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:48.635781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda057c2-72ff-44c4-8929-e4c1ed3f5f1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:48.668045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dda057c2-72ff-44c4-8929-e4c1ed3f5f1b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Jan 15 15:54:48.668949 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 410/814] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:49.678669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5d1aba75-b1bd-4cc5-83a0-08b9b3e50b4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:49.679603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5d1aba75-b1bd-4cc5-83a0-08b9b3e50b4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:49.685627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1aba75-b1bd-4cc5-83a0-08b9b3e50b4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:49.686082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1aba75-b1bd-4cc5-83a0-08b9b3e50b4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:49.686867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1aba75-b1bd-4cc5-83a0-08b9b3e50b4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:49.687304 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1aba75-b1bd-4cc5-83a0-08b9b3e50b4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:49.718362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5d1aba75-b1bd-4cc5-83a0-08b9b3e50b4d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Jan 15 15:54:49.718913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 405/815] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:50.730142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ac8e33f7-9cd0-4c58-a7c9-4bae1c7ed25e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:50.731085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ac8e33f7-9cd0-4c58-a7c9-4bae1c7ed25e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:50.737528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac8e33f7-9cd0-4c58-a7c9-4bae1c7ed25e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:50.737842 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac8e33f7-9cd0-4c58-a7c9-4bae1c7ed25e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:50.738619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac8e33f7-9cd0-4c58-a7c9-4bae1c7ed25e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:50.739049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac8e33f7-9cd0-4c58-a7c9-4bae1c7ed25e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:50.768029 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ac8e33f7-9cd0-4c58-a7c9-4bae1c7ed25e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042438 Jan 15 15:54:50.768605 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 411/816] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:51.783094 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-17c89016-b950-4b93-adab-032790b167a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:51.784483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-17c89016-b950-4b93-adab-032790b167a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:51.791118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c89016-b950-4b93-adab-032790b167a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:51.791632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c89016-b950-4b93-adab-032790b167a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:51.792471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c89016-b950-4b93-adab-032790b167a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:51.792922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c89016-b950-4b93-adab-032790b167a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:51.828513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-17c89016-b950-4b93-adab-032790b167a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051382 Jan 15 15:54:51.829202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 406/817] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:52.839918 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bffaba2a-42c5-4502-bdba-a6a1c8223162 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:52.841040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bffaba2a-42c5-4502-bdba-a6a1c8223162 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:52.847315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bffaba2a-42c5-4502-bdba-a6a1c8223162 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:52.847769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bffaba2a-42c5-4502-bdba-a6a1c8223162 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:52.848575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bffaba2a-42c5-4502-bdba-a6a1c8223162 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:52.849010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bffaba2a-42c5-4502-bdba-a6a1c8223162 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:52.877518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bffaba2a-42c5-4502-bdba-a6a1c8223162 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Jan 15 15:54:52.877999 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 412/818] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:53.888752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5af90371-c0d6-49d3-a32e-a26e46f968ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:53.889671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5af90371-c0d6-49d3-a32e-a26e46f968ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:53.895799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5af90371-c0d6-49d3-a32e-a26e46f968ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:53.896278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5af90371-c0d6-49d3-a32e-a26e46f968ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:53.897052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5af90371-c0d6-49d3-a32e-a26e46f968ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:53.897486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5af90371-c0d6-49d3-a32e-a26e46f968ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:53.925531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5af90371-c0d6-49d3-a32e-a26e46f968ae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Jan 15 15:54:53.926004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 407/819] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:54.936483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-609e9f88-e772-442f-9bca-b98f6c964b57 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:54.937394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-609e9f88-e772-442f-9bca-b98f6c964b57 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:54.943561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-609e9f88-e772-442f-9bca-b98f6c964b57 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:54.944014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-609e9f88-e772-442f-9bca-b98f6c964b57 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:54.944820 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-609e9f88-e772-442f-9bca-b98f6c964b57 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:54.945255 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-609e9f88-e772-442f-9bca-b98f6c964b57 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:54.974210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-609e9f88-e772-442f-9bca-b98f6c964b57 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 Jan 15 15:54:54.974688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 413/820] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:55.985206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-34c0afa9-87db-4a2a-ad44-322887d9dec4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:55.986121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-34c0afa9-87db-4a2a-ad44-322887d9dec4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:55.992377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c0afa9-87db-4a2a-ad44-322887d9dec4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:55.992832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c0afa9-87db-4a2a-ad44-322887d9dec4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:55.994138 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c0afa9-87db-4a2a-ad44-322887d9dec4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:55.994573 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c0afa9-87db-4a2a-ad44-322887d9dec4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:56.023243 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-34c0afa9-87db-4a2a-ad44-322887d9dec4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041730 Jan 15 15:54:56.023717 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 408/821] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:57.034401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dea77267-4843-4546-b669-574ddb6656c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:57.035319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dea77267-4843-4546-b669-574ddb6656c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:57.042457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dea77267-4843-4546-b669-574ddb6656c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:57.042941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dea77267-4843-4546-b669-574ddb6656c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:57.043732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dea77267-4843-4546-b669-574ddb6656c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:57.044194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dea77267-4843-4546-b669-574ddb6656c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:57.073019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dea77267-4843-4546-b669-574ddb6656c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Jan 15 15:54:57.073504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 414/822] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:54:58.084056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-62bae171-a1f1-4525-ae2b-20f752b258ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:58.085007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-62bae171-a1f1-4525-ae2b-20f752b258ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:58.091528 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62bae171-a1f1-4525-ae2b-20f752b258ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:58.091927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62bae171-a1f1-4525-ae2b-20f752b258ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:58.092730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62bae171-a1f1-4525-ae2b-20f752b258ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:58.093165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62bae171-a1f1-4525-ae2b-20f752b258ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:58.122332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-62bae171-a1f1-4525-ae2b-20f752b258ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042023 Jan 15 15:54:58.122870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 409/823] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:54:59.133501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6d5736d5-d50c-4962-b11d-c2fd87c8b9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:54:59.135217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6d5736d5-d50c-4962-b11d-c2fd87c8b9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:54:59.141788 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d5736d5-d50c-4962-b11d-c2fd87c8b9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:59.142186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d5736d5-d50c-4962-b11d-c2fd87c8b9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:59.142971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d5736d5-d50c-4962-b11d-c2fd87c8b9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:54:59.143420 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d5736d5-d50c-4962-b11d-c2fd87c8b9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:54:59.172002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6d5736d5-d50c-4962-b11d-c2fd87c8b9f0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 Jan 15 15:54:59.172583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 415/824] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:54:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:00.183245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7e16b67d-ea99-4785-afbd-fdb0373fb390 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:00.184105 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7e16b67d-ea99-4785-afbd-fdb0373fb390 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:00.190350 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e16b67d-ea99-4785-afbd-fdb0373fb390 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:00.190807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e16b67d-ea99-4785-afbd-fdb0373fb390 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:00.191596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e16b67d-ea99-4785-afbd-fdb0373fb390 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:00.192055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7e16b67d-ea99-4785-afbd-fdb0373fb390 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:00.221574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7e16b67d-ea99-4785-afbd-fdb0373fb390 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 Jan 15 15:55:00.222115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 410/825] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:01.233429 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a97eb0c9-cfdb-4925-9e90-eb1c9bc134bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:01.234277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a97eb0c9-cfdb-4925-9e90-eb1c9bc134bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:01.240459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a97eb0c9-cfdb-4925-9e90-eb1c9bc134bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:01.240909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a97eb0c9-cfdb-4925-9e90-eb1c9bc134bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:01.241682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a97eb0c9-cfdb-4925-9e90-eb1c9bc134bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:01.242115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a97eb0c9-cfdb-4925-9e90-eb1c9bc134bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:01.269894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a97eb0c9-cfdb-4925-9e90-eb1c9bc134bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040243 Jan 15 15:55:01.270440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 416/826] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:55:02.281162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3ef8c589-a9c1-4adb-a5a8-df5256abcf61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:02.282080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3ef8c589-a9c1-4adb-a5a8-df5256abcf61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:02.288584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ef8c589-a9c1-4adb-a5a8-df5256abcf61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:02.289025 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ef8c589-a9c1-4adb-a5a8-df5256abcf61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:02.289836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ef8c589-a9c1-4adb-a5a8-df5256abcf61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:02.290318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3ef8c589-a9c1-4adb-a5a8-df5256abcf61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:02.318012 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3ef8c589-a9c1-4adb-a5a8-df5256abcf61 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040576 Jan 15 15:55:02.318557 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 411/827] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:03.330013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ae1afa94-08ae-405e-8607-c77295dde2ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:03.330861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ae1afa94-08ae-405e-8607-c77295dde2ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:03.336869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae1afa94-08ae-405e-8607-c77295dde2ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:03.337319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae1afa94-08ae-405e-8607-c77295dde2ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:03.338096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae1afa94-08ae-405e-8607-c77295dde2ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:03.338535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae1afa94-08ae-405e-8607-c77295dde2ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:03.367133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ae1afa94-08ae-405e-8607-c77295dde2ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040906 Jan 15 15:55:03.369783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 417/828] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:04.378930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2e19c860-f3d6-46a9-96a1-5102fd3ff3ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:04.379813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2e19c860-f3d6-46a9-96a1-5102fd3ff3ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:04.386695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2e19c860-f3d6-46a9-96a1-5102fd3ff3ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:04.387149 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2e19c860-f3d6-46a9-96a1-5102fd3ff3ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:04.387936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2e19c860-f3d6-46a9-96a1-5102fd3ff3ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:04.388401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2e19c860-f3d6-46a9-96a1-5102fd3ff3ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:04.417165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2e19c860-f3d6-46a9-96a1-5102fd3ff3ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Jan 15 15:55:04.417714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 412/829] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:05.428675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-db0a8ca4-a8e0-475b-b494-e6ad7bcf5710 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:05.429694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-db0a8ca4-a8e0-475b-b494-e6ad7bcf5710 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:05.436076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db0a8ca4-a8e0-475b-b494-e6ad7bcf5710 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:05.436578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db0a8ca4-a8e0-475b-b494-e6ad7bcf5710 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:05.437360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db0a8ca4-a8e0-475b-b494-e6ad7bcf5710 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:05.437802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db0a8ca4-a8e0-475b-b494-e6ad7bcf5710 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:05.467047 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-db0a8ca4-a8e0-475b-b494-e6ad7bcf5710 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 Jan 15 15:55:05.467609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 418/830] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:06.478159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0ef1bfce-0e05-4219-9160-4e384fdc6b41 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:06.479070 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0ef1bfce-0e05-4219-9160-4e384fdc6b41 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:06.484957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef1bfce-0e05-4219-9160-4e384fdc6b41 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:06.485407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef1bfce-0e05-4219-9160-4e384fdc6b41 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:06.486185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef1bfce-0e05-4219-9160-4e384fdc6b41 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:06.486619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ef1bfce-0e05-4219-9160-4e384fdc6b41 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:06.514982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0ef1bfce-0e05-4219-9160-4e384fdc6b41 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 Jan 15 15:55:06.515533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 413/831] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:07.527032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bd3140b7-25ba-4934-b55d-3be46ab58504 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:07.527944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bd3140b7-25ba-4934-b55d-3be46ab58504 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:07.534221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd3140b7-25ba-4934-b55d-3be46ab58504 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:07.534619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd3140b7-25ba-4934-b55d-3be46ab58504 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:07.535403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd3140b7-25ba-4934-b55d-3be46ab58504 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:07.536101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd3140b7-25ba-4934-b55d-3be46ab58504 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:07.565230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bd3140b7-25ba-4934-b55d-3be46ab58504 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042540 Jan 15 15:55:07.565789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 419/832] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:08.577060 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a8299583-ce56-4ff5-8fda-b00316d1269f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:08.578031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a8299583-ce56-4ff5-8fda-b00316d1269f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:08.584301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a8299583-ce56-4ff5-8fda-b00316d1269f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:08.584767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a8299583-ce56-4ff5-8fda-b00316d1269f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:08.585565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a8299583-ce56-4ff5-8fda-b00316d1269f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:08.586009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a8299583-ce56-4ff5-8fda-b00316d1269f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:08.615711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a8299583-ce56-4ff5-8fda-b00316d1269f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042360 Jan 15 15:55:08.616289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 414/833] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:09.627471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0fb126dd-f9bf-4786-b74b-814cb5071f68 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:09.628418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0fb126dd-f9bf-4786-b74b-814cb5071f68 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:09.635116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fb126dd-f9bf-4786-b74b-814cb5071f68 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:09.635572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fb126dd-f9bf-4786-b74b-814cb5071f68 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:09.636381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fb126dd-f9bf-4786-b74b-814cb5071f68 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:09.636824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fb126dd-f9bf-4786-b74b-814cb5071f68 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:09.665704 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0fb126dd-f9bf-4786-b74b-814cb5071f68 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041937 Jan 15 15:55:09.666266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 420/834] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:10.677569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a724ea6f-5227-4694-b7d5-93ee0ae784dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:10.678487 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a724ea6f-5227-4694-b7d5-93ee0ae784dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:10.685012 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a724ea6f-5227-4694-b7d5-93ee0ae784dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:10.685468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a724ea6f-5227-4694-b7d5-93ee0ae784dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:10.686259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a724ea6f-5227-4694-b7d5-93ee0ae784dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:10.686699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a724ea6f-5227-4694-b7d5-93ee0ae784dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:10.715214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a724ea6f-5227-4694-b7d5-93ee0ae784dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042232 Jan 15 15:55:10.715768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 415/835] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:11.726314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-55044ef6-bdb4-4b0d-b981-bfe22530aa3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:11.727305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-55044ef6-bdb4-4b0d-b981-bfe22530aa3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:11.733533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55044ef6-bdb4-4b0d-b981-bfe22530aa3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:11.733983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55044ef6-bdb4-4b0d-b981-bfe22530aa3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:11.734757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55044ef6-bdb4-4b0d-b981-bfe22530aa3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:11.735189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55044ef6-bdb4-4b0d-b981-bfe22530aa3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:11.764757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-55044ef6-bdb4-4b0d-b981-bfe22530aa3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Jan 15 15:55:11.765302 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 421/836] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:12.775893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bfa60807-1f33-4519-abb4-e2faa77c7800 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:12.776838 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bfa60807-1f33-4519-abb4-e2faa77c7800 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:12.782983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfa60807-1f33-4519-abb4-e2faa77c7800 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:12.783430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfa60807-1f33-4519-abb4-e2faa77c7800 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:12.784312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfa60807-1f33-4519-abb4-e2faa77c7800 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:12.784750 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bfa60807-1f33-4519-abb4-e2faa77c7800 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:12.813911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bfa60807-1f33-4519-abb4-e2faa77c7800 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 Jan 15 15:55:12.814459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 416/837] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:13.825164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-15deed5e-1d05-4749-af75-004743f77b8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:13.826109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-15deed5e-1d05-4749-af75-004743f77b8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:13.832321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15deed5e-1d05-4749-af75-004743f77b8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:13.832768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15deed5e-1d05-4749-af75-004743f77b8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:13.833534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15deed5e-1d05-4749-af75-004743f77b8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:13.833965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-15deed5e-1d05-4749-af75-004743f77b8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:13.862662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-15deed5e-1d05-4749-af75-004743f77b8f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Jan 15 15:55:13.863364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 422/838] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:14.873778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d76e075d-3c99-4ec5-a99a-71020ab6177e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:14.874701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d76e075d-3c99-4ec5-a99a-71020ab6177e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:14.881062 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d76e075d-3c99-4ec5-a99a-71020ab6177e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:14.881515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d76e075d-3c99-4ec5-a99a-71020ab6177e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:14.882298 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d76e075d-3c99-4ec5-a99a-71020ab6177e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:14.882739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d76e075d-3c99-4ec5-a99a-71020ab6177e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:14.911407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d76e075d-3c99-4ec5-a99a-71020ab6177e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Jan 15 15:55:14.911957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 417/839] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:15.922543 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fef8c504-5bab-41f9-9417-609f9bad57c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:15.923446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fef8c504-5bab-41f9-9417-609f9bad57c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:15.929589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef8c504-5bab-41f9-9417-609f9bad57c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:15.930033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef8c504-5bab-41f9-9417-609f9bad57c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:15.930797 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef8c504-5bab-41f9-9417-609f9bad57c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:15.932188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef8c504-5bab-41f9-9417-609f9bad57c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:15.960067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fef8c504-5bab-41f9-9417-609f9bad57c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041237 Jan 15 15:55:15.960649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 423/840] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:16.972082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-08fcf114-f729-4820-8a26-85415ecd0409 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:16.973016 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-08fcf114-f729-4820-8a26-85415ecd0409 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:16.980003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08fcf114-f729-4820-8a26-85415ecd0409 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:16.980483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08fcf114-f729-4820-8a26-85415ecd0409 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:16.981259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08fcf114-f729-4820-8a26-85415ecd0409 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:16.981696 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08fcf114-f729-4820-8a26-85415ecd0409 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:17.010672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-08fcf114-f729-4820-8a26-85415ecd0409 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042432 Jan 15 15:55:17.011231 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 418/841] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:18.021802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5b8dcf50-692c-4d2d-acec-e86183a90251 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:18.022721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5b8dcf50-692c-4d2d-acec-e86183a90251 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:18.029240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8dcf50-692c-4d2d-acec-e86183a90251 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:18.029697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8dcf50-692c-4d2d-acec-e86183a90251 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:18.030487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8dcf50-692c-4d2d-acec-e86183a90251 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:18.030960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8dcf50-692c-4d2d-acec-e86183a90251 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:18.060664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5b8dcf50-692c-4d2d-acec-e86183a90251 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Jan 15 15:55:18.061207 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 424/842] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:19.071827 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0a986715-eb6e-4e3d-b84e-f0c24271ab6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:19.073297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0a986715-eb6e-4e3d-b84e-f0c24271ab6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:19.079502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a986715-eb6e-4e3d-b84e-f0c24271ab6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:19.079953 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a986715-eb6e-4e3d-b84e-f0c24271ab6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:19.080770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a986715-eb6e-4e3d-b84e-f0c24271ab6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:19.081211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a986715-eb6e-4e3d-b84e-f0c24271ab6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:19.109591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0a986715-eb6e-4e3d-b84e-f0c24271ab6c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Jan 15 15:55:19.110138 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 419/843] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:20.120766 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-37b1c29d-6f4f-432a-b407-d0b341c224fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:20.121758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-37b1c29d-6f4f-432a-b407-d0b341c224fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:20.127923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37b1c29d-6f4f-432a-b407-d0b341c224fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:20.128403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37b1c29d-6f4f-432a-b407-d0b341c224fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:20.129181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37b1c29d-6f4f-432a-b407-d0b341c224fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:20.129621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-37b1c29d-6f4f-432a-b407-d0b341c224fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:20.157809 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-37b1c29d-6f4f-432a-b407-d0b341c224fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040905 Jan 15 15:55:20.158350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 425/844] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:21.169368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-804dd237-0a3a-4818-9e32-942f66dd8c52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:21.170296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-804dd237-0a3a-4818-9e32-942f66dd8c52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:21.176082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-804dd237-0a3a-4818-9e32-942f66dd8c52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:21.176565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-804dd237-0a3a-4818-9e32-942f66dd8c52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:21.177349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-804dd237-0a3a-4818-9e32-942f66dd8c52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:21.177790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-804dd237-0a3a-4818-9e32-942f66dd8c52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:21.206336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-804dd237-0a3a-4818-9e32-942f66dd8c52 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040979 Jan 15 15:55:21.206879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 420/845] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:22.218004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-744994d6-9160-42c4-9981-a644a2ac38db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:22.219024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-744994d6-9160-42c4-9981-a644a2ac38db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:22.225301 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-744994d6-9160-42c4-9981-a644a2ac38db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:22.225756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-744994d6-9160-42c4-9981-a644a2ac38db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:22.226544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-744994d6-9160-42c4-9981-a644a2ac38db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:22.226984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-744994d6-9160-42c4-9981-a644a2ac38db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:22.255678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-744994d6-9160-42c4-9981-a644a2ac38db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041372 Jan 15 15:55:22.256258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 426/846] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:23.266766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5817e2a7-ece8-4b7b-b711-065c991f5bd5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:23.267721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5817e2a7-ece8-4b7b-b711-065c991f5bd5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:23.273956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5817e2a7-ece8-4b7b-b711-065c991f5bd5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:23.274436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5817e2a7-ece8-4b7b-b711-065c991f5bd5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:23.275272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5817e2a7-ece8-4b7b-b711-065c991f5bd5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:23.275683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5817e2a7-ece8-4b7b-b711-065c991f5bd5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:23.304458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5817e2a7-ece8-4b7b-b711-065c991f5bd5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041468 Jan 15 15:55:23.304944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 421/847] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:24.316251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-79a5129a-c373-4442-affd-2901f7acbfbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:24.317173 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-79a5129a-c373-4442-affd-2901f7acbfbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:24.323942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79a5129a-c373-4442-affd-2901f7acbfbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:24.324426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79a5129a-c373-4442-affd-2901f7acbfbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:24.325212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79a5129a-c373-4442-affd-2901f7acbfbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:24.325653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79a5129a-c373-4442-affd-2901f7acbfbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:24.354051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-79a5129a-c373-4442-affd-2901f7acbfbe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Jan 15 15:55:24.354536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 427/848] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:25.365568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-70ca4157-7f72-4c91-a80c-7ec3216d615d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:25.373054 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-70ca4157-7f72-4c91-a80c-7ec3216d615d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:25.373054 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70ca4157-7f72-4c91-a80c-7ec3216d615d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:25.373428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70ca4157-7f72-4c91-a80c-7ec3216d615d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:25.374217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70ca4157-7f72-4c91-a80c-7ec3216d615d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:25.374663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70ca4157-7f72-4c91-a80c-7ec3216d615d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:25.406064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-70ca4157-7f72-4c91-a80c-7ec3216d615d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Jan 15 15:55:25.406555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 422/849] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:26.417798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-22b9c3c1-342b-4d28-8250-415e46b76179 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:26.418709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-22b9c3c1-342b-4d28-8250-415e46b76179 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:26.424970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22b9c3c1-342b-4d28-8250-415e46b76179 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:26.425420 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22b9c3c1-342b-4d28-8250-415e46b76179 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:26.426196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22b9c3c1-342b-4d28-8250-415e46b76179 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:26.426632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22b9c3c1-342b-4d28-8250-415e46b76179 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:26.455269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-22b9c3c1-342b-4d28-8250-415e46b76179 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041706 Jan 15 15:55:26.455741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 428/850] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:27.466586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7a86848b-146a-4c0f-a04d-3d5b9906c3d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:27.467541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7a86848b-146a-4c0f-a04d-3d5b9906c3d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:27.473867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a86848b-146a-4c0f-a04d-3d5b9906c3d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:27.474319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a86848b-146a-4c0f-a04d-3d5b9906c3d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:27.475098 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a86848b-146a-4c0f-a04d-3d5b9906c3d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:27.475537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a86848b-146a-4c0f-a04d-3d5b9906c3d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:27.504690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7a86848b-146a-4c0f-a04d-3d5b9906c3d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Jan 15 15:55:27.505232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 423/851] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:28.516000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c5d20937-1732-4ffc-afd0-124defbac9c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:28.517074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c5d20937-1732-4ffc-afd0-124defbac9c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:28.524655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5d20937-1732-4ffc-afd0-124defbac9c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:28.525264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5d20937-1732-4ffc-afd0-124defbac9c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:28.526054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5d20937-1732-4ffc-afd0-124defbac9c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:28.526489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5d20937-1732-4ffc-afd0-124defbac9c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:28.557559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c5d20937-1732-4ffc-afd0-124defbac9c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Jan 15 15:55:28.558049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 429/852] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:29.568911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e0e0329b-b25b-4790-8af6-ec176a5924f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:29.569827 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e0e0329b-b25b-4790-8af6-ec176a5924f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:29.576665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0e0329b-b25b-4790-8af6-ec176a5924f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:29.577121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0e0329b-b25b-4790-8af6-ec176a5924f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:29.577908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0e0329b-b25b-4790-8af6-ec176a5924f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:29.578342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0e0329b-b25b-4790-8af6-ec176a5924f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:29.607419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e0e0329b-b25b-4790-8af6-ec176a5924f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 Jan 15 15:55:29.607993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 424/853] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:55:30.618746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f8f24aea-69f3-4335-b394-bc98a47f738d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:30.619900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f8f24aea-69f3-4335-b394-bc98a47f738d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:30.626134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8f24aea-69f3-4335-b394-bc98a47f738d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:30.626591 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8f24aea-69f3-4335-b394-bc98a47f738d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:30.627372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8f24aea-69f3-4335-b394-bc98a47f738d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:30.627813 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8f24aea-69f3-4335-b394-bc98a47f738d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:30.656385 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f8f24aea-69f3-4335-b394-bc98a47f738d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041469 Jan 15 15:55:30.656938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 430/854] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:31.668114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e0095e72-4e80-414d-a9b3-9e2fb8c99edd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:31.669059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e0095e72-4e80-414d-a9b3-9e2fb8c99edd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:31.675362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0095e72-4e80-414d-a9b3-9e2fb8c99edd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:31.675818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0095e72-4e80-414d-a9b3-9e2fb8c99edd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:31.676633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0095e72-4e80-414d-a9b3-9e2fb8c99edd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:31.677073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e0095e72-4e80-414d-a9b3-9e2fb8c99edd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:31.706003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e0095e72-4e80-414d-a9b3-9e2fb8c99edd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042368 Jan 15 15:55:31.706596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 425/855] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:32.718283 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fd6d7505-531b-41d7-9911-d2db51660e7b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:32.719197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fd6d7505-531b-41d7-9911-d2db51660e7b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:32.725149 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd6d7505-531b-41d7-9911-d2db51660e7b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:32.725600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd6d7505-531b-41d7-9911-d2db51660e7b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:32.726425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd6d7505-531b-41d7-9911-d2db51660e7b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:32.726865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd6d7505-531b-41d7-9911-d2db51660e7b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:32.756516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fd6d7505-531b-41d7-9911-d2db51660e7b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Jan 15 15:55:32.757112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 431/856] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:55:33.766933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e6757b6d-be9a-4e75-a6d1-81e8dc101060 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:33.767844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e6757b6d-be9a-4e75-a6d1-81e8dc101060 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:33.773966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e6757b6d-be9a-4e75-a6d1-81e8dc101060 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:33.774412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e6757b6d-be9a-4e75-a6d1-81e8dc101060 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:33.775975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e6757b6d-be9a-4e75-a6d1-81e8dc101060 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:33.776432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e6757b6d-be9a-4e75-a6d1-81e8dc101060 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:33.804519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e6757b6d-be9a-4e75-a6d1-81e8dc101060 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041233 Jan 15 15:55:33.805064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 426/857] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:34.815076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5649725a-c8c3-4cc9-8953-0ad3fc80a062 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:34.815993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5649725a-c8c3-4cc9-8953-0ad3fc80a062 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:34.822356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5649725a-c8c3-4cc9-8953-0ad3fc80a062 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:34.822800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5649725a-c8c3-4cc9-8953-0ad3fc80a062 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:34.823604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5649725a-c8c3-4cc9-8953-0ad3fc80a062 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:34.824040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5649725a-c8c3-4cc9-8953-0ad3fc80a062 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:34.852305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5649725a-c8c3-4cc9-8953-0ad3fc80a062 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040880 Jan 15 15:55:34.853402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 432/858] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:35.863915 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5b9cbf1a-10d5-4eab-bd85-7811d5a05317 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:35.864866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5b9cbf1a-10d5-4eab-bd85-7811d5a05317 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:35.871849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b9cbf1a-10d5-4eab-bd85-7811d5a05317 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:35.872335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b9cbf1a-10d5-4eab-bd85-7811d5a05317 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:35.873118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b9cbf1a-10d5-4eab-bd85-7811d5a05317 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:35.873554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5b9cbf1a-10d5-4eab-bd85-7811d5a05317 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:35.902109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5b9cbf1a-10d5-4eab-bd85-7811d5a05317 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041977 Jan 15 15:55:35.902654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 427/859] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:36.913646 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-29c60add-6735-4735-a474-4132a9e53158 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:36.914581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-29c60add-6735-4735-a474-4132a9e53158 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:36.921613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c60add-6735-4735-a474-4132a9e53158 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:36.922064 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c60add-6735-4735-a474-4132a9e53158 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:36.922844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c60add-6735-4735-a474-4132a9e53158 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:36.923279 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c60add-6735-4735-a474-4132a9e53158 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:36.952384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-29c60add-6735-4735-a474-4132a9e53158 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Jan 15 15:55:36.952941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 433/860] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:55:37.964329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9de74bbb-4d69-4bf8-b6f9-734031b9d388 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:37.965273 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9de74bbb-4d69-4bf8-b6f9-734031b9d388 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:37.971404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de74bbb-4d69-4bf8-b6f9-734031b9d388 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:37.972006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de74bbb-4d69-4bf8-b6f9-734031b9d388 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:37.972878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de74bbb-4d69-4bf8-b6f9-734031b9d388 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:37.973320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de74bbb-4d69-4bf8-b6f9-734031b9d388 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:38.002388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9de74bbb-4d69-4bf8-b6f9-734031b9d388 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Jan 15 15:55:38.002947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 428/861] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:39.013471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c99f4f7e-8893-4957-b568-cd4636240436 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:39.014392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c99f4f7e-8893-4957-b568-cd4636240436 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:39.020648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c99f4f7e-8893-4957-b568-cd4636240436 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:39.021111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c99f4f7e-8893-4957-b568-cd4636240436 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:39.021894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c99f4f7e-8893-4957-b568-cd4636240436 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:39.022332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c99f4f7e-8893-4957-b568-cd4636240436 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:39.052885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c99f4f7e-8893-4957-b568-cd4636240436 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Jan 15 15:55:39.053383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 434/862] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:40.065029 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b1a86318-5933-4fd6-b003-42c40a4b2578 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:40.065950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b1a86318-5933-4fd6-b003-42c40a4b2578 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:40.072869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a86318-5933-4fd6-b003-42c40a4b2578 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:40.073334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a86318-5933-4fd6-b003-42c40a4b2578 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:40.074120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a86318-5933-4fd6-b003-42c40a4b2578 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:40.074562 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b1a86318-5933-4fd6-b003-42c40a4b2578 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:40.102054 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b1a86318-5933-4fd6-b003-42c40a4b2578 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040797 Jan 15 15:55:40.102605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 429/863] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:41.112579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d9cb5581-23cc-48ed-a709-f9f1caf339d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:41.113469 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d9cb5581-23cc-48ed-a709-f9f1caf339d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:41.120499 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9cb5581-23cc-48ed-a709-f9f1caf339d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:41.120956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9cb5581-23cc-48ed-a709-f9f1caf339d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:41.121741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9cb5581-23cc-48ed-a709-f9f1caf339d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:41.122182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d9cb5581-23cc-48ed-a709-f9f1caf339d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:41.150599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d9cb5581-23cc-48ed-a709-f9f1caf339d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 Jan 15 15:55:41.151148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 435/864] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:42.162225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9382b172-ad94-441b-96ae-3a7305dbe43f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:42.163143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9382b172-ad94-441b-96ae-3a7305dbe43f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:42.169919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9382b172-ad94-441b-96ae-3a7305dbe43f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:42.170372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9382b172-ad94-441b-96ae-3a7305dbe43f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:42.171152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9382b172-ad94-441b-96ae-3a7305dbe43f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:42.171595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9382b172-ad94-441b-96ae-3a7305dbe43f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:42.201397 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9382b172-ad94-441b-96ae-3a7305dbe43f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 Jan 15 15:55:42.201944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 430/865] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:43.213356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9f88d598-2dd6-408f-be1d-4f4f9343ec39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:43.214265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9f88d598-2dd6-408f-be1d-4f4f9343ec39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:43.220507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f88d598-2dd6-408f-be1d-4f4f9343ec39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:43.220956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f88d598-2dd6-408f-be1d-4f4f9343ec39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:43.221728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f88d598-2dd6-408f-be1d-4f4f9343ec39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:43.222162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f88d598-2dd6-408f-be1d-4f4f9343ec39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:43.251213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9f88d598-2dd6-408f-be1d-4f4f9343ec39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042341 Jan 15 15:55:43.251751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 436/866] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:44.262437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9c110607-e0eb-4c7d-ab2c-8fba90428b0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:44.263382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9c110607-e0eb-4c7d-ab2c-8fba90428b0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:44.269634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c110607-e0eb-4c7d-ab2c-8fba90428b0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:44.270088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c110607-e0eb-4c7d-ab2c-8fba90428b0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:44.270875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c110607-e0eb-4c7d-ab2c-8fba90428b0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:44.271324 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c110607-e0eb-4c7d-ab2c-8fba90428b0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:44.300485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9c110607-e0eb-4c7d-ab2c-8fba90428b0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Jan 15 15:55:44.300968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 431/867] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:45.312318 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-43992ee3-ce73-4d87-a042-41df3567c4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:45.313177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-43992ee3-ce73-4d87-a042-41df3567c4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:45.319523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43992ee3-ce73-4d87-a042-41df3567c4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:45.320004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43992ee3-ce73-4d87-a042-41df3567c4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:45.320826 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43992ee3-ce73-4d87-a042-41df3567c4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:45.321900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43992ee3-ce73-4d87-a042-41df3567c4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:45.353440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-43992ee3-ce73-4d87-a042-41df3567c4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Jan 15 15:55:45.354003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 437/868] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:46.364743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8cd1140b-ae71-48a9-9be5-70ed5c6007ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:46.365587 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8cd1140b-ae71-48a9-9be5-70ed5c6007ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:46.372430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cd1140b-ae71-48a9-9be5-70ed5c6007ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:46.372879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cd1140b-ae71-48a9-9be5-70ed5c6007ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:46.383385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cd1140b-ae71-48a9-9be5-70ed5c6007ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:46.383385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cd1140b-ae71-48a9-9be5-70ed5c6007ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:46.402845 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8cd1140b-ae71-48a9-9be5-70ed5c6007ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Jan 15 15:55:46.403386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 432/869] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:47.414240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b581ab15-3447-4e0f-be61-6ecc078e6a40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:47.415193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b581ab15-3447-4e0f-be61-6ecc078e6a40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:47.421407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b581ab15-3447-4e0f-be61-6ecc078e6a40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:47.421869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b581ab15-3447-4e0f-be61-6ecc078e6a40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:47.422651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b581ab15-3447-4e0f-be61-6ecc078e6a40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:47.423102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b581ab15-3447-4e0f-be61-6ecc078e6a40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:47.451893 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b581ab15-3447-4e0f-be61-6ecc078e6a40 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Jan 15 15:55:47.452491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 438/870] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:48.463067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fca05dc6-e9be-44d3-95c1-bfcc73f2c121 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:48.463979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fca05dc6-e9be-44d3-95c1-bfcc73f2c121 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:48.470368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fca05dc6-e9be-44d3-95c1-bfcc73f2c121 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:48.470822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fca05dc6-e9be-44d3-95c1-bfcc73f2c121 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:48.471601 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fca05dc6-e9be-44d3-95c1-bfcc73f2c121 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:48.472038 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fca05dc6-e9be-44d3-95c1-bfcc73f2c121 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:48.500709 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fca05dc6-e9be-44d3-95c1-bfcc73f2c121 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041387 Jan 15 15:55:48.501253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 433/871] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:49.512340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a0dfe505-2f53-4c9f-a5f6-17584f81c93f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:49.513255 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a0dfe505-2f53-4c9f-a5f6-17584f81c93f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:49.519574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0dfe505-2f53-4c9f-a5f6-17584f81c93f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:49.520026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0dfe505-2f53-4c9f-a5f6-17584f81c93f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:49.520840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0dfe505-2f53-4c9f-a5f6-17584f81c93f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:49.521276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0dfe505-2f53-4c9f-a5f6-17584f81c93f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:49.550381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a0dfe505-2f53-4c9f-a5f6-17584f81c93f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Jan 15 15:55:49.550926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 439/872] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:50.562163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ff40f756-ca46-43f5-af03-827d175774dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:50.563100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ff40f756-ca46-43f5-af03-827d175774dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:50.569000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff40f756-ca46-43f5-af03-827d175774dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:50.569448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff40f756-ca46-43f5-af03-827d175774dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:50.570225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff40f756-ca46-43f5-af03-827d175774dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:50.570658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff40f756-ca46-43f5-af03-827d175774dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:50.598906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ff40f756-ca46-43f5-af03-827d175774dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Jan 15 15:55:50.599444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 434/873] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:51.610720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9031a514-4cc2-4cc9-bc49-b6553542776a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:51.611628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9031a514-4cc2-4cc9-bc49-b6553542776a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:51.618453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9031a514-4cc2-4cc9-bc49-b6553542776a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:51.618929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9031a514-4cc2-4cc9-bc49-b6553542776a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:51.619695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9031a514-4cc2-4cc9-bc49-b6553542776a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:51.620123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9031a514-4cc2-4cc9-bc49-b6553542776a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:51.649448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9031a514-4cc2-4cc9-bc49-b6553542776a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Jan 15 15:55:51.649995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 440/874] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:52.661258 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7fd8d75b-8bd9-415d-8477-3aed1acba2c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:52.662221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7fd8d75b-8bd9-415d-8477-3aed1acba2c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:52.670301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75b-8bd9-415d-8477-3aed1acba2c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:52.670756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75b-8bd9-415d-8477-3aed1acba2c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:52.671544 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75b-8bd9-415d-8477-3aed1acba2c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:52.671986 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75b-8bd9-415d-8477-3aed1acba2c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:52.705738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7fd8d75b-8bd9-415d-8477-3aed1acba2c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048592 Jan 15 15:55:52.706303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 435/875] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:55:53.717695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3bc9e93b-3f15-4994-a68e-ab456c2a1c77 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:53.718611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3bc9e93b-3f15-4994-a68e-ab456c2a1c77 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:53.724838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3bc9e93b-3f15-4994-a68e-ab456c2a1c77 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:53.725292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3bc9e93b-3f15-4994-a68e-ab456c2a1c77 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:53.726065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3bc9e93b-3f15-4994-a68e-ab456c2a1c77 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:53.726508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3bc9e93b-3f15-4994-a68e-ab456c2a1c77 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:53.754969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3bc9e93b-3f15-4994-a68e-ab456c2a1c77 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Jan 15 15:55:53.755529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 441/876] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:54.767128 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a2a4d3af-83b0-4100-8e6a-9af28bd33be9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:54.768049 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a2a4d3af-83b0-4100-8e6a-9af28bd33be9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:54.774946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2a4d3af-83b0-4100-8e6a-9af28bd33be9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:54.775398 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2a4d3af-83b0-4100-8e6a-9af28bd33be9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:54.776237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2a4d3af-83b0-4100-8e6a-9af28bd33be9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:54.776681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2a4d3af-83b0-4100-8e6a-9af28bd33be9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:54.804740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a2a4d3af-83b0-4100-8e6a-9af28bd33be9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Jan 15 15:55:54.805383 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 436/877] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:55.815773 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6a44dda5-2b17-4b14-bd13-f8dda7d7403d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:55.816714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6a44dda5-2b17-4b14-bd13-f8dda7d7403d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:55.823083 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a44dda5-2b17-4b14-bd13-f8dda7d7403d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:55.823539 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a44dda5-2b17-4b14-bd13-f8dda7d7403d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:55.824355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a44dda5-2b17-4b14-bd13-f8dda7d7403d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:55.824793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a44dda5-2b17-4b14-bd13-f8dda7d7403d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:55.855146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6a44dda5-2b17-4b14-bd13-f8dda7d7403d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Jan 15 15:55:55.855701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 442/878] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:56.866440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d8277605-ad95-4a94-b4c1-5c2fa205585b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:56.867553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d8277605-ad95-4a94-b4c1-5c2fa205585b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:56.874002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8277605-ad95-4a94-b4c1-5c2fa205585b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:56.874460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8277605-ad95-4a94-b4c1-5c2fa205585b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:56.875245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8277605-ad95-4a94-b4c1-5c2fa205585b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:56.875725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8277605-ad95-4a94-b4c1-5c2fa205585b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:56.904634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d8277605-ad95-4a94-b4c1-5c2fa205585b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Jan 15 15:55:56.905231 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 437/879] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:57.915988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cbe5d736-01e8-4f5e-8dbd-cb4e23183a8e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:57.916929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cbe5d736-01e8-4f5e-8dbd-cb4e23183a8e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:57.923135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe5d736-01e8-4f5e-8dbd-cb4e23183a8e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:57.923591 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe5d736-01e8-4f5e-8dbd-cb4e23183a8e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:57.924437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe5d736-01e8-4f5e-8dbd-cb4e23183a8e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:57.924877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbe5d736-01e8-4f5e-8dbd-cb4e23183a8e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:57.953240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cbe5d736-01e8-4f5e-8dbd-cb4e23183a8e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 Jan 15 15:55:57.953724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 443/880] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:55:58.964257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-150d5eea-ddf2-4d85-b3ae-d92bd76e7455 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:55:58.965174 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-150d5eea-ddf2-4d85-b3ae-d92bd76e7455 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:55:58.971385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-150d5eea-ddf2-4d85-b3ae-d92bd76e7455 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:58.971844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-150d5eea-ddf2-4d85-b3ae-d92bd76e7455 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:58.972649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-150d5eea-ddf2-4d85-b3ae-d92bd76e7455 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:55:58.973091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-150d5eea-ddf2-4d85-b3ae-d92bd76e7455 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:55:59.001658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-150d5eea-ddf2-4d85-b3ae-d92bd76e7455 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 Jan 15 15:55:59.002138 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 438/881] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:55:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:00.013290 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2075b1c7-a424-4e49-8f33-bd069dc364bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:00.014218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2075b1c7-a424-4e49-8f33-bd069dc364bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:00.020544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2075b1c7-a424-4e49-8f33-bd069dc364bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:00.021001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2075b1c7-a424-4e49-8f33-bd069dc364bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:00.021783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2075b1c7-a424-4e49-8f33-bd069dc364bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:00.022227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2075b1c7-a424-4e49-8f33-bd069dc364bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:00.052069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2075b1c7-a424-4e49-8f33-bd069dc364bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042461 Jan 15 15:56:00.052610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 444/882] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:56:01.063925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b78d7541-c628-451e-a006-e197da958ab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:01.064956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b78d7541-c628-451e-a006-e197da958ab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:01.071670 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b78d7541-c628-451e-a006-e197da958ab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:01.072165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b78d7541-c628-451e-a006-e197da958ab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:01.072958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b78d7541-c628-451e-a006-e197da958ab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:01.073644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b78d7541-c628-451e-a006-e197da958ab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:01.104033 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b78d7541-c628-451e-a006-e197da958ab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Jan 15 15:56:01.104717 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 439/883] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:01.973053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:56:01.973535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 15:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:56:02.115262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c835363a-e52a-4dc3-aed3-9c10133effa0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:02.116181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c835363a-e52a-4dc3-aed3-9c10133effa0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:02.123194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c835363a-e52a-4dc3-aed3-9c10133effa0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:02.123637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c835363a-e52a-4dc3-aed3-9c10133effa0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:02.124437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c835363a-e52a-4dc3-aed3-9c10133effa0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:02.124870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c835363a-e52a-4dc3-aed3-9c10133effa0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:02.154113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c835363a-e52a-4dc3-aed3-9c10133effa0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Jan 15 15:56:02.154668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 445/884] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:03.165961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-57227046-ca79-4802-a1ae-bbad6757635a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:03.166886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-57227046-ca79-4802-a1ae-bbad6757635a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:03.173163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57227046-ca79-4802-a1ae-bbad6757635a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:03.173616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57227046-ca79-4802-a1ae-bbad6757635a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:03.174408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57227046-ca79-4802-a1ae-bbad6757635a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:03.174850 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-57227046-ca79-4802-a1ae-bbad6757635a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:03.204374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-57227046-ca79-4802-a1ae-bbad6757635a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042571 Jan 15 15:56:03.205009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 440/885] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:04.215599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-acafc196-c386-4c08-a1db-e6436f92f379 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:04.216571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-acafc196-c386-4c08-a1db-e6436f92f379 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:04.222948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acafc196-c386-4c08-a1db-e6436f92f379 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:04.223338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acafc196-c386-4c08-a1db-e6436f92f379 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:04.224107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acafc196-c386-4c08-a1db-e6436f92f379 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:04.224567 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acafc196-c386-4c08-a1db-e6436f92f379 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:04.253716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-acafc196-c386-4c08-a1db-e6436f92f379 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 Jan 15 15:56:04.254259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 446/886] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:05.264946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8b8245a9-336b-4ff8-9e3d-3b5d83e332b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:05.265879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8b8245a9-336b-4ff8-9e3d-3b5d83e332b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:05.272001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b8245a9-336b-4ff8-9e3d-3b5d83e332b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:05.272486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b8245a9-336b-4ff8-9e3d-3b5d83e332b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:05.273281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b8245a9-336b-4ff8-9e3d-3b5d83e332b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:05.274061 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b8245a9-336b-4ff8-9e3d-3b5d83e332b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:05.302613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8b8245a9-336b-4ff8-9e3d-3b5d83e332b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041405 Jan 15 15:56:05.303157 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 441/887] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:06.313874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f5298c6e-92e6-487c-b684-7beec762c3c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:06.314745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f5298c6e-92e6-487c-b684-7beec762c3c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:06.321848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f5298c6e-92e6-487c-b684-7beec762c3c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:06.322294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f5298c6e-92e6-487c-b684-7beec762c3c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:06.323063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f5298c6e-92e6-487c-b684-7beec762c3c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:06.323494 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f5298c6e-92e6-487c-b684-7beec762c3c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:06.351117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f5298c6e-92e6-487c-b684-7beec762c3c0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 Jan 15 15:56:06.351929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 447/888] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:07.362781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c65034ea-f5e5-44fe-b15b-7823485ba1c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:07.363630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c65034ea-f5e5-44fe-b15b-7823485ba1c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:07.369849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c65034ea-f5e5-44fe-b15b-7823485ba1c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:07.370311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c65034ea-f5e5-44fe-b15b-7823485ba1c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:07.371095 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c65034ea-f5e5-44fe-b15b-7823485ba1c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:07.371539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c65034ea-f5e5-44fe-b15b-7823485ba1c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:07.402307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c65034ea-f5e5-44fe-b15b-7823485ba1c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043346 Jan 15 15:56:07.402972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 442/889] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:08.413841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5ab7aaed-9dd6-4e3c-b54e-7565c29d605c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:08.414880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5ab7aaed-9dd6-4e3c-b54e-7565c29d605c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:08.421195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ab7aaed-9dd6-4e3c-b54e-7565c29d605c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:08.421639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ab7aaed-9dd6-4e3c-b54e-7565c29d605c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:08.422417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ab7aaed-9dd6-4e3c-b54e-7565c29d605c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:08.422887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ab7aaed-9dd6-4e3c-b54e-7565c29d605c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:08.453394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5ab7aaed-9dd6-4e3c-b54e-7565c29d605c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Jan 15 15:56:08.453939 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 448/890] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:09.465159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-78129cfc-b10e-4bee-952b-71f957c0af78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:09.466077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-78129cfc-b10e-4bee-952b-71f957c0af78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:09.474776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-78129cfc-b10e-4bee-952b-71f957c0af78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:09.475529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-78129cfc-b10e-4bee-952b-71f957c0af78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:09.477357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-78129cfc-b10e-4bee-952b-71f957c0af78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:09.477804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-78129cfc-b10e-4bee-952b-71f957c0af78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:09.506567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-78129cfc-b10e-4bee-952b-71f957c0af78 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Jan 15 15:56:09.507115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 443/891] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:10.517291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-84ea50ef-4f62-49dc-9210-db593cd917fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:10.518124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-84ea50ef-4f62-49dc-9210-db593cd917fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:10.524760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84ea50ef-4f62-49dc-9210-db593cd917fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:10.525240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84ea50ef-4f62-49dc-9210-db593cd917fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:10.526019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84ea50ef-4f62-49dc-9210-db593cd917fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:10.526454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-84ea50ef-4f62-49dc-9210-db593cd917fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:10.557475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-84ea50ef-4f62-49dc-9210-db593cd917fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Jan 15 15:56:10.558015 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 449/892] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:11.567988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-18adb578-ea55-4f16-9ab8-e0cf2f0a2028 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:11.568916 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-18adb578-ea55-4f16-9ab8-e0cf2f0a2028 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:11.576041 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18adb578-ea55-4f16-9ab8-e0cf2f0a2028 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:11.576570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18adb578-ea55-4f16-9ab8-e0cf2f0a2028 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:11.577295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18adb578-ea55-4f16-9ab8-e0cf2f0a2028 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:11.577731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18adb578-ea55-4f16-9ab8-e0cf2f0a2028 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:11.605869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-18adb578-ea55-4f16-9ab8-e0cf2f0a2028 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 Jan 15 15:56:11.606408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 444/893] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:12.617119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0b060a21-b741-4175-904f-cc7ba031a5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:12.618600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0b060a21-b741-4175-904f-cc7ba031a5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:12.624852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b060a21-b741-4175-904f-cc7ba031a5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:12.625312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b060a21-b741-4175-904f-cc7ba031a5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:12.626090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b060a21-b741-4175-904f-cc7ba031a5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:12.626531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b060a21-b741-4175-904f-cc7ba031a5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:12.654989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0b060a21-b741-4175-904f-cc7ba031a5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041714 Jan 15 15:56:12.655549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 450/894] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:13.666940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-30b6e4dc-6531-4a67-b8c7-9b7767f083a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:13.667873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-30b6e4dc-6531-4a67-b8c7-9b7767f083a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:13.674100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30b6e4dc-6531-4a67-b8c7-9b7767f083a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:13.674550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30b6e4dc-6531-4a67-b8c7-9b7767f083a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:13.675333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30b6e4dc-6531-4a67-b8c7-9b7767f083a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:13.675770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-30b6e4dc-6531-4a67-b8c7-9b7767f083a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:13.704906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-30b6e4dc-6531-4a67-b8c7-9b7767f083a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Jan 15 15:56:13.705451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 445/895] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:14.716479 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3267dc68-224d-4453-9de7-6b5c2084c784 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:14.717344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3267dc68-224d-4453-9de7-6b5c2084c784 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:14.723495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3267dc68-224d-4453-9de7-6b5c2084c784 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:14.723940 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3267dc68-224d-4453-9de7-6b5c2084c784 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:14.724757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3267dc68-224d-4453-9de7-6b5c2084c784 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:14.725192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3267dc68-224d-4453-9de7-6b5c2084c784 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:14.754163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3267dc68-224d-4453-9de7-6b5c2084c784 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 Jan 15 15:56:14.754705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 451/896] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:15.766149 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a40cd54d-4a65-417d-aa46-b26b73a7a775 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:15.766984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a40cd54d-4a65-417d-aa46-b26b73a7a775 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:15.773190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a40cd54d-4a65-417d-aa46-b26b73a7a775 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:15.773641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a40cd54d-4a65-417d-aa46-b26b73a7a775 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:15.774410 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a40cd54d-4a65-417d-aa46-b26b73a7a775 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:15.774845 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a40cd54d-4a65-417d-aa46-b26b73a7a775 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:15.804973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a40cd54d-4a65-417d-aa46-b26b73a7a775 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Jan 15 15:56:15.805530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 446/897] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:16.816773 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-869a3b0e-732e-4b20-a838-f42d303ab987 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:16.817609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-869a3b0e-732e-4b20-a838-f42d303ab987 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:16.824592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-869a3b0e-732e-4b20-a838-f42d303ab987 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:16.825049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-869a3b0e-732e-4b20-a838-f42d303ab987 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:16.825836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-869a3b0e-732e-4b20-a838-f42d303ab987 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:16.826273 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-869a3b0e-732e-4b20-a838-f42d303ab987 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:16.855710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-869a3b0e-732e-4b20-a838-f42d303ab987 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042714 Jan 15 15:56:16.856283 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 452/898] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:17.866775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f6dbab66-6782-45a4-b7e1-40851ba6912d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:17.867606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f6dbab66-6782-45a4-b7e1-40851ba6912d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:17.874797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6dbab66-6782-45a4-b7e1-40851ba6912d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:17.875248 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6dbab66-6782-45a4-b7e1-40851ba6912d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:17.876017 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6dbab66-6782-45a4-b7e1-40851ba6912d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:17.876480 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f6dbab66-6782-45a4-b7e1-40851ba6912d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:17.907009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f6dbab66-6782-45a4-b7e1-40851ba6912d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Jan 15 15:56:17.907566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 447/899] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:18.204039 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:56:18.204226 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 15:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:56:18.918181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-92c9da3a-404b-4f33-b7ea-f3ce8fbbb1da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:18.919133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-92c9da3a-404b-4f33-b7ea-f3ce8fbbb1da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:18.925397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92c9da3a-404b-4f33-b7ea-f3ce8fbbb1da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:18.925849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92c9da3a-404b-4f33-b7ea-f3ce8fbbb1da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:18.926625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92c9da3a-404b-4f33-b7ea-f3ce8fbbb1da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:18.927060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92c9da3a-404b-4f33-b7ea-f3ce8fbbb1da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:18.956683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-92c9da3a-404b-4f33-b7ea-f3ce8fbbb1da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 Jan 15 15:56:18.957233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 453/900] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:19.968697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-69fd7017-7afc-464f-b6b4-24da000e858f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:19.969515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-69fd7017-7afc-464f-b6b4-24da000e858f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:19.975337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69fd7017-7afc-464f-b6b4-24da000e858f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:19.975783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69fd7017-7afc-464f-b6b4-24da000e858f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:19.976585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69fd7017-7afc-464f-b6b4-24da000e858f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:19.977018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69fd7017-7afc-464f-b6b4-24da000e858f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:20.005271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-69fd7017-7afc-464f-b6b4-24da000e858f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040689 Jan 15 15:56:20.005817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 448/901] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:21.016756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-71bb832b-e8af-4d03-933f-00d980518f18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:21.017625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-71bb832b-e8af-4d03-933f-00d980518f18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:21.023860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71bb832b-e8af-4d03-933f-00d980518f18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:21.024353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71bb832b-e8af-4d03-933f-00d980518f18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:21.025134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71bb832b-e8af-4d03-933f-00d980518f18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:21.026293 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71bb832b-e8af-4d03-933f-00d980518f18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:21.055688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-71bb832b-e8af-4d03-933f-00d980518f18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042776 Jan 15 15:56:21.056265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 454/902] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:22.067055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-991d9001-f008-4ba4-bcfb-3357e17e9295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:22.067980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-991d9001-f008-4ba4-bcfb-3357e17e9295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:22.074884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-991d9001-f008-4ba4-bcfb-3357e17e9295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:22.075343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-991d9001-f008-4ba4-bcfb-3357e17e9295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:22.076130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-991d9001-f008-4ba4-bcfb-3357e17e9295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:22.076608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-991d9001-f008-4ba4-bcfb-3357e17e9295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:22.104989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-991d9001-f008-4ba4-bcfb-3357e17e9295 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041718 Jan 15 15:56:22.105538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 449/903] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:23.116297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d538ddf7-7020-4945-bbab-80c15c2c27b5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:23.117140 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d538ddf7-7020-4945-bbab-80c15c2c27b5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:23.123383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d538ddf7-7020-4945-bbab-80c15c2c27b5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:23.123840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d538ddf7-7020-4945-bbab-80c15c2c27b5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:23.124648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d538ddf7-7020-4945-bbab-80c15c2c27b5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:23.125121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d538ddf7-7020-4945-bbab-80c15c2c27b5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:23.153893 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d538ddf7-7020-4945-bbab-80c15c2c27b5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041415 Jan 15 15:56:23.154534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 455/904] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:24.165047 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cd7e1fe4-b8ab-45dc-bd05-7f450929e1be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:24.166612 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cd7e1fe4-b8ab-45dc-bd05-7f450929e1be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:24.172921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd7e1fe4-b8ab-45dc-bd05-7f450929e1be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:24.173378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd7e1fe4-b8ab-45dc-bd05-7f450929e1be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:24.174164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd7e1fe4-b8ab-45dc-bd05-7f450929e1be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:24.174610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd7e1fe4-b8ab-45dc-bd05-7f450929e1be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:24.202490 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cd7e1fe4-b8ab-45dc-bd05-7f450929e1be tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Jan 15 15:56:24.203033 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 450/905] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:25.214594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9216c5c6-0369-4fb9-935a-849ebffd0c38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:25.215516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9216c5c6-0369-4fb9-935a-849ebffd0c38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:25.221880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9216c5c6-0369-4fb9-935a-849ebffd0c38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:25.222336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9216c5c6-0369-4fb9-935a-849ebffd0c38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:25.223127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9216c5c6-0369-4fb9-935a-849ebffd0c38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:25.223649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9216c5c6-0369-4fb9-935a-849ebffd0c38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:25.252671 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9216c5c6-0369-4fb9-935a-849ebffd0c38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042445 Jan 15 15:56:25.253238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 456/906] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:26.264840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-37ab77e5-22eb-4b20-9030-23fd04e56a4b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:26.265784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-37ab77e5-22eb-4b20-9030-23fd04e56a4b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:26.271968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37ab77e5-22eb-4b20-9030-23fd04e56a4b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:26.272430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37ab77e5-22eb-4b20-9030-23fd04e56a4b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:26.273250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37ab77e5-22eb-4b20-9030-23fd04e56a4b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:26.273682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37ab77e5-22eb-4b20-9030-23fd04e56a4b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:26.304992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-37ab77e5-22eb-4b20-9030-23fd04e56a4b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 Jan 15 15:56:26.305538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 451/907] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:27.316095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bdbadf61-48c1-45bf-8147-9908c57e1d92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:27.317065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bdbadf61-48c1-45bf-8147-9908c57e1d92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:27.323866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdbadf61-48c1-45bf-8147-9908c57e1d92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:27.324351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdbadf61-48c1-45bf-8147-9908c57e1d92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:27.325136 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdbadf61-48c1-45bf-8147-9908c57e1d92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:27.325606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdbadf61-48c1-45bf-8147-9908c57e1d92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:27.355510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bdbadf61-48c1-45bf-8147-9908c57e1d92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Jan 15 15:56:27.356082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 457/908] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:28.366274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-352bee50-4eb1-4d72-91ad-27673b348e27 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:28.367105 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-352bee50-4eb1-4d72-91ad-27673b348e27 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:28.374202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352bee50-4eb1-4d72-91ad-27673b348e27 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:28.381051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352bee50-4eb1-4d72-91ad-27673b348e27 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:28.381051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352bee50-4eb1-4d72-91ad-27673b348e27 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:28.381051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352bee50-4eb1-4d72-91ad-27673b348e27 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:28.404633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-352bee50-4eb1-4d72-91ad-27673b348e27 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 Jan 15 15:56:28.405176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 452/909] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:29.416237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5c8a5acd-180c-4142-8619-43813596ab98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:29.417711 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5c8a5acd-180c-4142-8619-43813596ab98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:29.424068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c8a5acd-180c-4142-8619-43813596ab98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:29.424550 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c8a5acd-180c-4142-8619-43813596ab98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:29.425339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c8a5acd-180c-4142-8619-43813596ab98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:29.425769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c8a5acd-180c-4142-8619-43813596ab98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:29.455030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5c8a5acd-180c-4142-8619-43813596ab98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jan 15 15:56:29.455599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 458/910] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:30.466674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-31ea30e2-70e9-453f-a300-4fd006e0c45e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:30.467589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-31ea30e2-70e9-453f-a300-4fd006e0c45e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:30.473855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-31ea30e2-70e9-453f-a300-4fd006e0c45e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:30.474305 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-31ea30e2-70e9-453f-a300-4fd006e0c45e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:30.475083 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-31ea30e2-70e9-453f-a300-4fd006e0c45e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:30.475519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-31ea30e2-70e9-453f-a300-4fd006e0c45e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:30.504996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-31ea30e2-70e9-453f-a300-4fd006e0c45e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 Jan 15 15:56:30.505538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 453/911] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:31.518431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b5af0e69-7035-4450-a289-0e458d069b2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:31.519334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b5af0e69-7035-4450-a289-0e458d069b2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:31.526346 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5af0e69-7035-4450-a289-0e458d069b2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:31.527174 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5af0e69-7035-4450-a289-0e458d069b2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:31.528468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5af0e69-7035-4450-a289-0e458d069b2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:31.528906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5af0e69-7035-4450-a289-0e458d069b2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:31.559871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b5af0e69-7035-4450-a289-0e458d069b2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Jan 15 15:56:31.560908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 459/912] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:32.571873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fd736bfb-b78a-4d3b-8582-e849ba35b5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:32.572830 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fd736bfb-b78a-4d3b-8582-e849ba35b5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:32.579548 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd736bfb-b78a-4d3b-8582-e849ba35b5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:32.580006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd736bfb-b78a-4d3b-8582-e849ba35b5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:32.580833 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd736bfb-b78a-4d3b-8582-e849ba35b5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:32.581274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fd736bfb-b78a-4d3b-8582-e849ba35b5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:32.610800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fd736bfb-b78a-4d3b-8582-e849ba35b5b4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042646 Jan 15 15:56:32.611356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 454/913] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:33.623124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-637d530e-e192-45b8-89fc-aad1e9f496e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:33.623951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-637d530e-e192-45b8-89fc-aad1e9f496e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:33.629834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-637d530e-e192-45b8-89fc-aad1e9f496e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:33.630401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-637d530e-e192-45b8-89fc-aad1e9f496e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:33.631157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-637d530e-e192-45b8-89fc-aad1e9f496e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:33.631592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-637d530e-e192-45b8-89fc-aad1e9f496e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:33.661762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-637d530e-e192-45b8-89fc-aad1e9f496e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043394 Jan 15 15:56:33.664825 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 460/914] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:34.673808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0159ebd9-ae0b-4b83-b8f6-5665e7310e6b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:34.674716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0159ebd9-ae0b-4b83-b8f6-5665e7310e6b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:34.680894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0159ebd9-ae0b-4b83-b8f6-5665e7310e6b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:34.681344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0159ebd9-ae0b-4b83-b8f6-5665e7310e6b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:34.682113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0159ebd9-ae0b-4b83-b8f6-5665e7310e6b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:34.682903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0159ebd9-ae0b-4b83-b8f6-5665e7310e6b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:34.711118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0159ebd9-ae0b-4b83-b8f6-5665e7310e6b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Jan 15 15:56:34.711653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 455/915] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:35.723216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0033a496-bdcb-4364-a6d0-773d5ddbe9a2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:35.724179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0033a496-bdcb-4364-a6d0-773d5ddbe9a2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:35.731073 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0033a496-bdcb-4364-a6d0-773d5ddbe9a2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:35.731530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0033a496-bdcb-4364-a6d0-773d5ddbe9a2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:35.732351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0033a496-bdcb-4364-a6d0-773d5ddbe9a2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:35.732805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0033a496-bdcb-4364-a6d0-773d5ddbe9a2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:35.761548 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0033a496-bdcb-4364-a6d0-773d5ddbe9a2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Jan 15 15:56:35.762090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 461/916] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:36.771850 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bca52881-9e84-4068-ab42-50f7a4e6bd75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:36.772860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bca52881-9e84-4068-ab42-50f7a4e6bd75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:36.779625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bca52881-9e84-4068-ab42-50f7a4e6bd75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:36.780081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bca52881-9e84-4068-ab42-50f7a4e6bd75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:36.780894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bca52881-9e84-4068-ab42-50f7a4e6bd75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:36.781347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bca52881-9e84-4068-ab42-50f7a4e6bd75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:36.810454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bca52881-9e84-4068-ab42-50f7a4e6bd75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 Jan 15 15:56:36.811052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 456/917] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:37.821808 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6d35163d-1b69-4c2e-a2d8-eab901db78ce tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:37.822729 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6d35163d-1b69-4c2e-a2d8-eab901db78ce tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:37.828937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d35163d-1b69-4c2e-a2d8-eab901db78ce tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:37.829385 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d35163d-1b69-4c2e-a2d8-eab901db78ce tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:37.830154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d35163d-1b69-4c2e-a2d8-eab901db78ce tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:37.830587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d35163d-1b69-4c2e-a2d8-eab901db78ce tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:37.858875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6d35163d-1b69-4c2e-a2d8-eab901db78ce tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040914 Jan 15 15:56:37.859414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 462/918] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:38.870658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1ebb0147-741e-4fd5-9d70-79ede27767f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:38.871579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1ebb0147-741e-4fd5-9d70-79ede27767f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:38.877741 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ebb0147-741e-4fd5-9d70-79ede27767f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:38.878196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ebb0147-741e-4fd5-9d70-79ede27767f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:38.878978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ebb0147-741e-4fd5-9d70-79ede27767f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:38.879417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ebb0147-741e-4fd5-9d70-79ede27767f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:38.908584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1ebb0147-741e-4fd5-9d70-79ede27767f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042235 Jan 15 15:56:38.909133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 457/919] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:39.919777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3ef919f6-fecd-4ff9-97e5-5987f7f6df35 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:39.920724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3ef919f6-fecd-4ff9-97e5-5987f7f6df35 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:39.926900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ef919f6-fecd-4ff9-97e5-5987f7f6df35 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:39.927347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ef919f6-fecd-4ff9-97e5-5987f7f6df35 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:39.928156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ef919f6-fecd-4ff9-97e5-5987f7f6df35 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:39.928594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ef919f6-fecd-4ff9-97e5-5987f7f6df35 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:39.956773 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3ef919f6-fecd-4ff9-97e5-5987f7f6df35 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041681 Jan 15 15:56:39.957323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 463/920] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:40.968815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d435401d-f170-43b0-b3d1-4ab65349cccc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:40.969736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d435401d-f170-43b0-b3d1-4ab65349cccc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:40.976006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d435401d-f170-43b0-b3d1-4ab65349cccc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:40.976500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d435401d-f170-43b0-b3d1-4ab65349cccc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:40.977286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d435401d-f170-43b0-b3d1-4ab65349cccc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:40.977735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d435401d-f170-43b0-b3d1-4ab65349cccc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:41.005577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d435401d-f170-43b0-b3d1-4ab65349cccc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040555 Jan 15 15:56:41.006126 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 458/921] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:42.016372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2d5154fd-bc28-4b00-aa5e-4fbd1e76f3e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:42.017295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2d5154fd-bc28-4b00-aa5e-4fbd1e76f3e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:42.023886 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d5154fd-bc28-4b00-aa5e-4fbd1e76f3e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:42.024378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d5154fd-bc28-4b00-aa5e-4fbd1e76f3e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:42.025165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d5154fd-bc28-4b00-aa5e-4fbd1e76f3e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:42.026102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d5154fd-bc28-4b00-aa5e-4fbd1e76f3e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:42.056131 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2d5154fd-bc28-4b00-aa5e-4fbd1e76f3e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 Jan 15 15:56:42.056712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 464/922] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:43.067603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-68b20d99-a5a7-4fb4-91c5-e9d6af1d6c65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:43.068547 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-68b20d99-a5a7-4fb4-91c5-e9d6af1d6c65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:43.074760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68b20d99-a5a7-4fb4-91c5-e9d6af1d6c65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:43.075207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68b20d99-a5a7-4fb4-91c5-e9d6af1d6c65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:43.075980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68b20d99-a5a7-4fb4-91c5-e9d6af1d6c65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:43.076461 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68b20d99-a5a7-4fb4-91c5-e9d6af1d6c65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:43.104544 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-68b20d99-a5a7-4fb4-91c5-e9d6af1d6c65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040099 Jan 15 15:56:43.105245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 459/923] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:44.115547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9164b414-b8fb-45ef-9c6f-cf5def07e032 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:44.116486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9164b414-b8fb-45ef-9c6f-cf5def07e032 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:44.123342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9164b414-b8fb-45ef-9c6f-cf5def07e032 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:44.123793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9164b414-b8fb-45ef-9c6f-cf5def07e032 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:44.124601 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9164b414-b8fb-45ef-9c6f-cf5def07e032 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:44.125040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9164b414-b8fb-45ef-9c6f-cf5def07e032 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:44.153583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9164b414-b8fb-45ef-9c6f-cf5def07e032 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041725 Jan 15 15:56:44.154129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 465/924] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:45.164386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9598f039-9fc5-4918-ab5c-e789e656a533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:45.165302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9598f039-9fc5-4918-ab5c-e789e656a533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:45.171700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9598f039-9fc5-4918-ab5c-e789e656a533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:45.172176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9598f039-9fc5-4918-ab5c-e789e656a533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:45.172982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9598f039-9fc5-4918-ab5c-e789e656a533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:45.173416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9598f039-9fc5-4918-ab5c-e789e656a533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:45.202484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9598f039-9fc5-4918-ab5c-e789e656a533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042060 Jan 15 15:56:45.203022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 460/925] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:46.214103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a7ed5a06-45a9-4f61-8520-52b3be341545 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:46.215055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a7ed5a06-45a9-4f61-8520-52b3be341545 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:46.221335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7ed5a06-45a9-4f61-8520-52b3be341545 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:46.221790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7ed5a06-45a9-4f61-8520-52b3be341545 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:46.222577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7ed5a06-45a9-4f61-8520-52b3be341545 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:46.223019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7ed5a06-45a9-4f61-8520-52b3be341545 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:46.250791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a7ed5a06-45a9-4f61-8520-52b3be341545 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Jan 15 15:56:46.251336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 466/926] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:47.262176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e50334b1-cc3c-4643-9ea1-72542c7398c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:47.263380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e50334b1-cc3c-4643-9ea1-72542c7398c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:47.269624 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e50334b1-cc3c-4643-9ea1-72542c7398c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:47.270081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e50334b1-cc3c-4643-9ea1-72542c7398c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:47.270852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e50334b1-cc3c-4643-9ea1-72542c7398c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:47.271282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e50334b1-cc3c-4643-9ea1-72542c7398c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:47.301310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e50334b1-cc3c-4643-9ea1-72542c7398c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Jan 15 15:56:47.301879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 461/927] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:56:48.312878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3a39df56-1d36-410d-99d4-f9d2d5c602fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:48.313794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3a39df56-1d36-410d-99d4-f9d2d5c602fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:48.320017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3a39df56-1d36-410d-99d4-f9d2d5c602fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:48.320501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3a39df56-1d36-410d-99d4-f9d2d5c602fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:48.321288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3a39df56-1d36-410d-99d4-f9d2d5c602fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:48.321725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3a39df56-1d36-410d-99d4-f9d2d5c602fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:48.351026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3a39df56-1d36-410d-99d4-f9d2d5c602fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 Jan 15 15:56:48.351578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 467/928] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:49.361925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5aa3c5b3-1912-4514-b2df-b3bca35660e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:49.362836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5aa3c5b3-1912-4514-b2df-b3bca35660e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:49.368767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5aa3c5b3-1912-4514-b2df-b3bca35660e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:49.369749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5aa3c5b3-1912-4514-b2df-b3bca35660e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:49.370606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5aa3c5b3-1912-4514-b2df-b3bca35660e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:49.371044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5aa3c5b3-1912-4514-b2df-b3bca35660e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:49.399546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5aa3c5b3-1912-4514-b2df-b3bca35660e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Jan 15 15:56:49.400091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 462/929] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:50.410874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-adccf2b8-cdc0-4c8b-a4be-11433605962b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:50.417625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-adccf2b8-cdc0-4c8b-a4be-11433605962b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:50.418969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adccf2b8-cdc0-4c8b-a4be-11433605962b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:50.419417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adccf2b8-cdc0-4c8b-a4be-11433605962b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:50.420217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adccf2b8-cdc0-4c8b-a4be-11433605962b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:50.420654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adccf2b8-cdc0-4c8b-a4be-11433605962b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:50.449787 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-adccf2b8-cdc0-4c8b-a4be-11433605962b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Jan 15 15:56:50.452911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 468/930] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 15:56:51.461360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a9cad973-0b7a-49f0-8e04-3ce7ad2ea105 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:51.462270 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a9cad973-0b7a-49f0-8e04-3ce7ad2ea105 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:51.468537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a9cad973-0b7a-49f0-8e04-3ce7ad2ea105 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:51.468987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a9cad973-0b7a-49f0-8e04-3ce7ad2ea105 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:51.469760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a9cad973-0b7a-49f0-8e04-3ce7ad2ea105 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:51.470196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a9cad973-0b7a-49f0-8e04-3ce7ad2ea105 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:51.499982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a9cad973-0b7a-49f0-8e04-3ce7ad2ea105 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Jan 15 15:56:51.500571 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 463/931] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:52.511364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-18535e8d-a16b-42b1-b884-ced971e53c5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:52.512307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-18535e8d-a16b-42b1-b884-ced971e53c5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:52.518742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18535e8d-a16b-42b1-b884-ced971e53c5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:52.519190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18535e8d-a16b-42b1-b884-ced971e53c5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:52.519988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18535e8d-a16b-42b1-b884-ced971e53c5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:52.520452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-18535e8d-a16b-42b1-b884-ced971e53c5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:52.550069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-18535e8d-a16b-42b1-b884-ced971e53c5c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043007 Jan 15 15:56:52.550632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 469/932] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:53.562310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-07a9e392-1d91-41af-8c79-a936b5fefd3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:53.563249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-07a9e392-1d91-41af-8c79-a936b5fefd3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:53.570099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07a9e392-1d91-41af-8c79-a936b5fefd3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:53.570556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07a9e392-1d91-41af-8c79-a936b5fefd3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:53.571335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07a9e392-1d91-41af-8c79-a936b5fefd3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:53.571765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07a9e392-1d91-41af-8c79-a936b5fefd3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:53.610148 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-07a9e392-1d91-41af-8c79-a936b5fefd3a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052428 Jan 15 15:56:53.610720 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 464/933] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:54.621722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-329c611e-0ddd-48d9-aa03-6d28a7d4dac3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:54.622640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-329c611e-0ddd-48d9-aa03-6d28a7d4dac3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:54.628874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-329c611e-0ddd-48d9-aa03-6d28a7d4dac3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:54.629325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-329c611e-0ddd-48d9-aa03-6d28a7d4dac3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:54.630097 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-329c611e-0ddd-48d9-aa03-6d28a7d4dac3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:54.630534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-329c611e-0ddd-48d9-aa03-6d28a7d4dac3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:54.659518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-329c611e-0ddd-48d9-aa03-6d28a7d4dac3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041724 Jan 15 15:56:54.660060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 470/934] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:55.670830 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b7ee9604-30e2-497b-8900-471398c038c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:55.671743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b7ee9604-30e2-497b-8900-471398c038c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:55.677951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7ee9604-30e2-497b-8900-471398c038c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:55.678388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7ee9604-30e2-497b-8900-471398c038c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:55.679164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7ee9604-30e2-497b-8900-471398c038c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:55.679593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b7ee9604-30e2-497b-8900-471398c038c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:55.707858 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b7ee9604-30e2-497b-8900-471398c038c3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040834 Jan 15 15:56:55.708431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 465/935] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:56.719224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b1755bd3-5d39-459b-935c-ef9bb2037e9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:56.720185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b1755bd3-5d39-459b-935c-ef9bb2037e9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:56.726379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1755bd3-5d39-459b-935c-ef9bb2037e9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:56.726828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1755bd3-5d39-459b-935c-ef9bb2037e9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:56.727595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1755bd3-5d39-459b-935c-ef9bb2037e9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:56.728029 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b1755bd3-5d39-459b-935c-ef9bb2037e9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:56.756926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b1755bd3-5d39-459b-935c-ef9bb2037e9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Jan 15 15:56:56.757465 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 471/936] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:57.768317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-74649344-0619-406d-8f6a-110d077b3d74 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:57.769238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-74649344-0619-406d-8f6a-110d077b3d74 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:57.775511 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74649344-0619-406d-8f6a-110d077b3d74 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:57.775968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74649344-0619-406d-8f6a-110d077b3d74 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:57.776865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74649344-0619-406d-8f6a-110d077b3d74 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:57.777811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74649344-0619-406d-8f6a-110d077b3d74 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:57.807405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-74649344-0619-406d-8f6a-110d077b3d74 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Jan 15 15:56:57.807961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 466/937] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:58.818809 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8afcb0a4-4719-420e-b47c-cfaf541793fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:58.819719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8afcb0a4-4719-420e-b47c-cfaf541793fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:58.826272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8afcb0a4-4719-420e-b47c-cfaf541793fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:58.826728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8afcb0a4-4719-420e-b47c-cfaf541793fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:58.827493 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8afcb0a4-4719-420e-b47c-cfaf541793fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:58.827924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8afcb0a4-4719-420e-b47c-cfaf541793fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:58.857246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8afcb0a4-4719-420e-b47c-cfaf541793fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Jan 15 15:56:58.857796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 472/938] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:56:59.869422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8d5a88a6-2b0e-4458-8296-75f14dd06c5f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:56:59.870339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8d5a88a6-2b0e-4458-8296-75f14dd06c5f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:56:59.877151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d5a88a6-2b0e-4458-8296-75f14dd06c5f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:59.877607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d5a88a6-2b0e-4458-8296-75f14dd06c5f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:59.878388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d5a88a6-2b0e-4458-8296-75f14dd06c5f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:56:59.878828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d5a88a6-2b0e-4458-8296-75f14dd06c5f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:56:59.907651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8d5a88a6-2b0e-4458-8296-75f14dd06c5f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Jan 15 15:56:59.908242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 467/939] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:56:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:00.919517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6a6bd23d-7010-498c-bff7-8fb9db33db1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:00.920481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6a6bd23d-7010-498c-bff7-8fb9db33db1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:00.927060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6bd23d-7010-498c-bff7-8fb9db33db1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:00.927491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6bd23d-7010-498c-bff7-8fb9db33db1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:00.928423 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6bd23d-7010-498c-bff7-8fb9db33db1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:00.928860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6bd23d-7010-498c-bff7-8fb9db33db1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:00.958751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6a6bd23d-7010-498c-bff7-8fb9db33db1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Jan 15 15:57:00.959296 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 473/940] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:01.970369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-00353979-6474-4710-b12c-bd284cb0ec60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:01.971280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-00353979-6474-4710-b12c-bd284cb0ec60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:01.977539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00353979-6474-4710-b12c-bd284cb0ec60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:01.977995 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00353979-6474-4710-b12c-bd284cb0ec60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:01.978775 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00353979-6474-4710-b12c-bd284cb0ec60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:01.979214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00353979-6474-4710-b12c-bd284cb0ec60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:02.008385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-00353979-6474-4710-b12c-bd284cb0ec60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041744 Jan 15 15:57:02.008868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 468/941] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:03.019264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ec766c6-4a47-4912-b051-8219899da2df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:03.020203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ec766c6-4a47-4912-b051-8219899da2df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:03.026376 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec766c6-4a47-4912-b051-8219899da2df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:03.026867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec766c6-4a47-4912-b051-8219899da2df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:03.027657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec766c6-4a47-4912-b051-8219899da2df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:03.028093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec766c6-4a47-4912-b051-8219899da2df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:03.056900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ec766c6-4a47-4912-b051-8219899da2df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041326 Jan 15 15:57:03.057455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 474/942] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:04.068932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d817ad4d-9e5c-4205-9c19-dba825458910 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:04.069860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d817ad4d-9e5c-4205-9c19-dba825458910 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:04.076613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d817ad4d-9e5c-4205-9c19-dba825458910 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:04.077074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d817ad4d-9e5c-4205-9c19-dba825458910 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:04.077864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d817ad4d-9e5c-4205-9c19-dba825458910 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:04.078310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d817ad4d-9e5c-4205-9c19-dba825458910 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:04.107182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d817ad4d-9e5c-4205-9c19-dba825458910 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Jan 15 15:57:04.107728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 469/943] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:05.118370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d5eb1a6d-a1ac-4b1a-99cf-50fcce74e34d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:05.119210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d5eb1a6d-a1ac-4b1a-99cf-50fcce74e34d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:05.125664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5eb1a6d-a1ac-4b1a-99cf-50fcce74e34d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:05.126116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5eb1a6d-a1ac-4b1a-99cf-50fcce74e34d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:05.126882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5eb1a6d-a1ac-4b1a-99cf-50fcce74e34d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:05.127313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5eb1a6d-a1ac-4b1a-99cf-50fcce74e34d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:05.155837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d5eb1a6d-a1ac-4b1a-99cf-50fcce74e34d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041288 Jan 15 15:57:05.156402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 475/944] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:06.167388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2ed085a2-f176-4ba1-842f-3886c5facf12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:06.168440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2ed085a2-f176-4ba1-842f-3886c5facf12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:06.174690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ed085a2-f176-4ba1-842f-3886c5facf12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:06.175146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ed085a2-f176-4ba1-842f-3886c5facf12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:06.175930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ed085a2-f176-4ba1-842f-3886c5facf12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:06.176397 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ed085a2-f176-4ba1-842f-3886c5facf12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:06.205507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2ed085a2-f176-4ba1-842f-3886c5facf12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Jan 15 15:57:06.206053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 470/945] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:07.216579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-796a0de8-8946-497e-85eb-4094f61199ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:07.217482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-796a0de8-8946-497e-85eb-4094f61199ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:07.223738 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-796a0de8-8946-497e-85eb-4094f61199ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:07.224208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-796a0de8-8946-497e-85eb-4094f61199ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:07.224988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-796a0de8-8946-497e-85eb-4094f61199ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:07.225420 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-796a0de8-8946-497e-85eb-4094f61199ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:07.254039 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-796a0de8-8946-497e-85eb-4094f61199ea tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041857 Jan 15 15:57:07.254585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 476/946] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:08.265253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6b4899a5-3390-4a9a-a760-a0489ad3ec47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:08.266177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6b4899a5-3390-4a9a-a760-a0489ad3ec47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:08.272459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6b4899a5-3390-4a9a-a760-a0489ad3ec47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:08.272914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6b4899a5-3390-4a9a-a760-a0489ad3ec47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:08.273695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6b4899a5-3390-4a9a-a760-a0489ad3ec47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:08.274133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6b4899a5-3390-4a9a-a760-a0489ad3ec47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:08.303766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6b4899a5-3390-4a9a-a760-a0489ad3ec47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Jan 15 15:57:08.304373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 471/947] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:09.315184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f4ab4d6e-551b-46ff-b603-760968997bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:09.316025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f4ab4d6e-551b-46ff-b603-760968997bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:09.322307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ab4d6e-551b-46ff-b603-760968997bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:09.322761 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ab4d6e-551b-46ff-b603-760968997bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:09.323747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ab4d6e-551b-46ff-b603-760968997bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:09.324215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ab4d6e-551b-46ff-b603-760968997bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:09.351840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f4ab4d6e-551b-46ff-b603-760968997bd6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040470 Jan 15 15:57:09.352422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 477/948] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:10.363769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9d22bf7d-b80d-4521-8e9b-38bf2dd814d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:10.364713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9d22bf7d-b80d-4521-8e9b-38bf2dd814d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:10.370863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7d-b80d-4521-8e9b-38bf2dd814d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:10.371311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7d-b80d-4521-8e9b-38bf2dd814d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:10.372089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7d-b80d-4521-8e9b-38bf2dd814d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:10.372546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d22bf7d-b80d-4521-8e9b-38bf2dd814d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:10.400275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9d22bf7d-b80d-4521-8e9b-38bf2dd814d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040196 Jan 15 15:57:10.400815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 472/949] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:11.412557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0f8cde3a-c1b9-4d38-a4ba-7d4c72987c81 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:11.413479 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0f8cde3a-c1b9-4d38-a4ba-7d4c72987c81 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:11.420269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f8cde3a-c1b9-4d38-a4ba-7d4c72987c81 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:11.420724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f8cde3a-c1b9-4d38-a4ba-7d4c72987c81 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:11.421516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f8cde3a-c1b9-4d38-a4ba-7d4c72987c81 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:11.421958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f8cde3a-c1b9-4d38-a4ba-7d4c72987c81 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:11.450459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0f8cde3a-c1b9-4d38-a4ba-7d4c72987c81 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041724 Jan 15 15:57:11.451011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 478/950] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:12.461617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f732053f-96ac-4942-870b-0c417da44d0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:12.462558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f732053f-96ac-4942-870b-0c417da44d0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:12.469560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f732053f-96ac-4942-870b-0c417da44d0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:12.470007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f732053f-96ac-4942-870b-0c417da44d0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:12.470780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f732053f-96ac-4942-870b-0c417da44d0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:12.471209 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f732053f-96ac-4942-870b-0c417da44d0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:12.499451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f732053f-96ac-4942-870b-0c417da44d0f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Jan 15 15:57:12.499995 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 473/951] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:13.510724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ff0fc3ea-0c92-49be-8536-f7c4715b58af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:13.511635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ff0fc3ea-0c92-49be-8536-f7c4715b58af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:13.518361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff0fc3ea-0c92-49be-8536-f7c4715b58af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:13.518805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff0fc3ea-0c92-49be-8536-f7c4715b58af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:13.519571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff0fc3ea-0c92-49be-8536-f7c4715b58af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:13.520004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff0fc3ea-0c92-49be-8536-f7c4715b58af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:13.547540 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ff0fc3ea-0c92-49be-8536-f7c4715b58af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040597 Jan 15 15:57:13.548078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 479/952] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:14.558729 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-62f1181a-809d-468e-97b2-30a529e984d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:14.559739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-62f1181a-809d-468e-97b2-30a529e984d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:14.566122 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62f1181a-809d-468e-97b2-30a529e984d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:14.566578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62f1181a-809d-468e-97b2-30a529e984d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:14.567369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62f1181a-809d-468e-97b2-30a529e984d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:14.567809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-62f1181a-809d-468e-97b2-30a529e984d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:14.597049 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-62f1181a-809d-468e-97b2-30a529e984d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Jan 15 15:57:14.597603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 474/953] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:15.609265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-906188dc-4a81-4b1e-82d4-0014bf4891dd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:15.610178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-906188dc-4a81-4b1e-82d4-0014bf4891dd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:15.616407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906188dc-4a81-4b1e-82d4-0014bf4891dd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:15.616854 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906188dc-4a81-4b1e-82d4-0014bf4891dd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:15.617621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906188dc-4a81-4b1e-82d4-0014bf4891dd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:15.618054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-906188dc-4a81-4b1e-82d4-0014bf4891dd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:15.646529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-906188dc-4a81-4b1e-82d4-0014bf4891dd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Jan 15 15:57:15.647091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 480/954] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:16.658132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2642ab27-a070-477c-8042-6e6483dfca97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:16.659043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2642ab27-a070-477c-8042-6e6483dfca97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:16.665271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2642ab27-a070-477c-8042-6e6483dfca97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:16.665716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2642ab27-a070-477c-8042-6e6483dfca97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:16.666489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2642ab27-a070-477c-8042-6e6483dfca97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:16.666922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2642ab27-a070-477c-8042-6e6483dfca97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:16.696878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2642ab27-a070-477c-8042-6e6483dfca97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 Jan 15 15:57:16.697420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 475/955] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:17.708481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8b4517db-79b0-4c22-8f0d-d54f997ff923 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:17.709395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8b4517db-79b0-4c22-8f0d-d54f997ff923 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:17.716221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4517db-79b0-4c22-8f0d-d54f997ff923 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:17.716693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4517db-79b0-4c22-8f0d-d54f997ff923 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:17.717476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4517db-79b0-4c22-8f0d-d54f997ff923 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:17.717914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4517db-79b0-4c22-8f0d-d54f997ff923 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:17.746613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8b4517db-79b0-4c22-8f0d-d54f997ff923 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 Jan 15 15:57:17.747241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 481/956] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:18.757914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-820716f5-1196-4146-bbc0-6673733577ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:18.758834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-820716f5-1196-4146-bbc0-6673733577ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:18.765663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-820716f5-1196-4146-bbc0-6673733577ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:18.766123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-820716f5-1196-4146-bbc0-6673733577ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:18.766914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-820716f5-1196-4146-bbc0-6673733577ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:18.767357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-820716f5-1196-4146-bbc0-6673733577ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:18.796751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-820716f5-1196-4146-bbc0-6673733577ef tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042581 Jan 15 15:57:18.797306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 476/957] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:19.808409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7d3ac374-d2ef-4b3f-9609-c05fb258e2e4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:19.809706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7d3ac374-d2ef-4b3f-9609-c05fb258e2e4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:19.816068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d3ac374-d2ef-4b3f-9609-c05fb258e2e4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:19.816558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d3ac374-d2ef-4b3f-9609-c05fb258e2e4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:19.817358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d3ac374-d2ef-4b3f-9609-c05fb258e2e4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:19.817787 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d3ac374-d2ef-4b3f-9609-c05fb258e2e4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:19.847589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7d3ac374-d2ef-4b3f-9609-c05fb258e2e4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 Jan 15 15:57:19.848165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 482/958] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:20.859171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9638d776-ab89-441c-9ddb-885181c7c3e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:20.860241 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9638d776-ab89-441c-9ddb-885181c7c3e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:20.866222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9638d776-ab89-441c-9ddb-885181c7c3e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:20.866680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9638d776-ab89-441c-9ddb-885181c7c3e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:20.867476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9638d776-ab89-441c-9ddb-885181c7c3e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:20.867925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9638d776-ab89-441c-9ddb-885181c7c3e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:20.897705 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9638d776-ab89-441c-9ddb-885181c7c3e0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 Jan 15 15:57:20.898264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 477/959] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:21.909305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f4faeb54-491e-4987-b842-c57391c12b89 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:21.910221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f4faeb54-491e-4987-b842-c57391c12b89 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:21.916458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4faeb54-491e-4987-b842-c57391c12b89 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:21.916911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4faeb54-491e-4987-b842-c57391c12b89 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:21.917685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4faeb54-491e-4987-b842-c57391c12b89 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:21.918658 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4faeb54-491e-4987-b842-c57391c12b89 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:21.947845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f4faeb54-491e-4987-b842-c57391c12b89 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Jan 15 15:57:21.948441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 483/960] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:22.958101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5d1d47f7-a42c-47b3-8557-5c7c7fcb9a8a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:22.959022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5d1d47f7-a42c-47b3-8557-5c7c7fcb9a8a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:22.965972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1d47f7-a42c-47b3-8557-5c7c7fcb9a8a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:22.966438 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1d47f7-a42c-47b3-8557-5c7c7fcb9a8a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:22.967235 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1d47f7-a42c-47b3-8557-5c7c7fcb9a8a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:22.967667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5d1d47f7-a42c-47b3-8557-5c7c7fcb9a8a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:22.996715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5d1d47f7-a42c-47b3-8557-5c7c7fcb9a8a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042189 Jan 15 15:57:22.997608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 478/961] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:24.008015 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-be4dab1f-9f55-4564-b717-ac136d6e25c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:24.008965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-be4dab1f-9f55-4564-b717-ac136d6e25c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:24.015290 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-be4dab1f-9f55-4564-b717-ac136d6e25c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:24.015740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-be4dab1f-9f55-4564-b717-ac136d6e25c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:24.016546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-be4dab1f-9f55-4564-b717-ac136d6e25c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:24.016982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-be4dab1f-9f55-4564-b717-ac136d6e25c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:24.048118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-be4dab1f-9f55-4564-b717-ac136d6e25c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Jan 15 15:57:24.048715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 484/962] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:25.059016 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4bde30bb-4990-4954-a770-e06dd21e4743 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:25.059933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4bde30bb-4990-4954-a770-e06dd21e4743 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:25.066700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bde30bb-4990-4954-a770-e06dd21e4743 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:25.067159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bde30bb-4990-4954-a770-e06dd21e4743 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:25.067953 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bde30bb-4990-4954-a770-e06dd21e4743 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:25.068418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bde30bb-4990-4954-a770-e06dd21e4743 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:25.098499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4bde30bb-4990-4954-a770-e06dd21e4743 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Jan 15 15:57:25.099055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 479/963] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:26.110714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7896d475-427f-42a3-99c6-31d3d847a3fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:26.111555 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7896d475-427f-42a3-99c6-31d3d847a3fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:26.117873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7896d475-427f-42a3-99c6-31d3d847a3fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:26.118321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7896d475-427f-42a3-99c6-31d3d847a3fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:26.119092 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7896d475-427f-42a3-99c6-31d3d847a3fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:26.120022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7896d475-427f-42a3-99c6-31d3d847a3fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:26.148869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7896d475-427f-42a3-99c6-31d3d847a3fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041995 Jan 15 15:57:26.149427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 485/964] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:27.160875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d9e0231-2ced-4dd2-aec0-cd7eb8fe4c93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:27.161801 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d9e0231-2ced-4dd2-aec0-cd7eb8fe4c93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:27.168767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d9e0231-2ced-4dd2-aec0-cd7eb8fe4c93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:27.169226 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d9e0231-2ced-4dd2-aec0-cd7eb8fe4c93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:27.170026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d9e0231-2ced-4dd2-aec0-cd7eb8fe4c93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:27.170476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d9e0231-2ced-4dd2-aec0-cd7eb8fe4c93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:27.200749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d9e0231-2ced-4dd2-aec0-cd7eb8fe4c93 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Jan 15 15:57:27.201503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 480/965] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:28.211772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c0f79384-1997-4fe1-912f-27b510bc3499 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:28.212716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c0f79384-1997-4fe1-912f-27b510bc3499 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:28.219078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0f79384-1997-4fe1-912f-27b510bc3499 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:28.219531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0f79384-1997-4fe1-912f-27b510bc3499 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:28.220343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0f79384-1997-4fe1-912f-27b510bc3499 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:28.220786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c0f79384-1997-4fe1-912f-27b510bc3499 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:28.250626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c0f79384-1997-4fe1-912f-27b510bc3499 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Jan 15 15:57:28.251186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 486/966] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:29.261903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2282f872-71ea-4f9d-aa73-06b5e0aed115 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:29.262855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2282f872-71ea-4f9d-aa73-06b5e0aed115 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:29.269050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2282f872-71ea-4f9d-aa73-06b5e0aed115 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:29.269506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2282f872-71ea-4f9d-aa73-06b5e0aed115 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:29.270427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2282f872-71ea-4f9d-aa73-06b5e0aed115 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:29.270711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2282f872-71ea-4f9d-aa73-06b5e0aed115 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:29.300369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2282f872-71ea-4f9d-aa73-06b5e0aed115 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jan 15 15:57:29.300935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 481/967] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:30.310839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3aa5f8e8-9d2e-4b1a-b021-9b6f14e9c300 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:30.311753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3aa5f8e8-9d2e-4b1a-b021-9b6f14e9c300 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:30.317896 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3aa5f8e8-9d2e-4b1a-b021-9b6f14e9c300 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:30.318345 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3aa5f8e8-9d2e-4b1a-b021-9b6f14e9c300 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:30.319122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3aa5f8e8-9d2e-4b1a-b021-9b6f14e9c300 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:30.319554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3aa5f8e8-9d2e-4b1a-b021-9b6f14e9c300 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:30.350094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3aa5f8e8-9d2e-4b1a-b021-9b6f14e9c300 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Jan 15 15:57:30.350659 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 487/968] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:31.361731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-63143aab-9744-4f98-8128-ce94aed72872 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:31.362642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-63143aab-9744-4f98-8128-ce94aed72872 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:31.368528 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63143aab-9744-4f98-8128-ce94aed72872 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:31.368981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63143aab-9744-4f98-8128-ce94aed72872 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:31.369758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63143aab-9744-4f98-8128-ce94aed72872 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:31.370192 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-63143aab-9744-4f98-8128-ce94aed72872 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:31.399984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-63143aab-9744-4f98-8128-ce94aed72872 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041881 Jan 15 15:57:31.400784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 482/969] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:32.411839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c5a5af87-28d6-4b06-bb5c-23e5bf93f8c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:32.412803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c5a5af87-28d6-4b06-bb5c-23e5bf93f8c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:32.419885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5a5af87-28d6-4b06-bb5c-23e5bf93f8c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:32.420359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5a5af87-28d6-4b06-bb5c-23e5bf93f8c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:32.421134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5a5af87-28d6-4b06-bb5c-23e5bf93f8c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:32.421563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5a5af87-28d6-4b06-bb5c-23e5bf93f8c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:32.451803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c5a5af87-28d6-4b06-bb5c-23e5bf93f8c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Jan 15 15:57:32.452402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 488/970] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:33.462524 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-da8796a0-abe1-446d-b02c-d23bf2680aa7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:33.463436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-da8796a0-abe1-446d-b02c-d23bf2680aa7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:33.476326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da8796a0-abe1-446d-b02c-d23bf2680aa7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:33.476326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da8796a0-abe1-446d-b02c-d23bf2680aa7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:33.476326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da8796a0-abe1-446d-b02c-d23bf2680aa7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:33.476326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da8796a0-abe1-446d-b02c-d23bf2680aa7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:33.501269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-da8796a0-abe1-446d-b02c-d23bf2680aa7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042393 Jan 15 15:57:33.501842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 483/971] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:34.512488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-20a069be-b89e-495c-a310-e1de3219fb8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:34.513486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-20a069be-b89e-495c-a310-e1de3219fb8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:34.519237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20a069be-b89e-495c-a310-e1de3219fb8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:34.519687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20a069be-b89e-495c-a310-e1de3219fb8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:34.520495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20a069be-b89e-495c-a310-e1de3219fb8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:34.520933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-20a069be-b89e-495c-a310-e1de3219fb8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:34.553483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-20a069be-b89e-495c-a310-e1de3219fb8c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Jan 15 15:57:34.554052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 489/972] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:35.572221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0325292c-29d6-4d49-85a6-b2018e764550 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:35.573361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0325292c-29d6-4d49-85a6-b2018e764550 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:35.581013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0325292c-29d6-4d49-85a6-b2018e764550 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:35.581476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0325292c-29d6-4d49-85a6-b2018e764550 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:35.582300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0325292c-29d6-4d49-85a6-b2018e764550 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:35.582745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0325292c-29d6-4d49-85a6-b2018e764550 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:35.613237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0325292c-29d6-4d49-85a6-b2018e764550 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Jan 15 15:57:35.613925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 484/973] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:36.624509 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-df6adfa0-0724-4158-bf17-5cfe8ae4c2bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:36.625426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-df6adfa0-0724-4158-bf17-5cfe8ae4c2bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:36.631506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df6adfa0-0724-4158-bf17-5cfe8ae4c2bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:36.631958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df6adfa0-0724-4158-bf17-5cfe8ae4c2bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:36.632780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df6adfa0-0724-4158-bf17-5cfe8ae4c2bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:36.633216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df6adfa0-0724-4158-bf17-5cfe8ae4c2bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:36.662961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-df6adfa0-0724-4158-bf17-5cfe8ae4c2bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Jan 15 15:57:36.663516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 490/974] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:37.674040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-db2a67ea-33f1-42b1-8c2d-2115b775524b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:37.674965 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-db2a67ea-33f1-42b1-8c2d-2115b775524b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:37.681207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2a67ea-33f1-42b1-8c2d-2115b775524b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:37.681667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2a67ea-33f1-42b1-8c2d-2115b775524b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:37.682459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2a67ea-33f1-42b1-8c2d-2115b775524b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:37.682907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2a67ea-33f1-42b1-8c2d-2115b775524b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:37.712019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-db2a67ea-33f1-42b1-8c2d-2115b775524b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Jan 15 15:57:37.712774 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 485/975] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:38.723064 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6d643e09-31e0-4152-9874-b59a9c1f0581 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:38.723975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6d643e09-31e0-4152-9874-b59a9c1f0581 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:38.730768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d643e09-31e0-4152-9874-b59a9c1f0581 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:38.731242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d643e09-31e0-4152-9874-b59a9c1f0581 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:38.732031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d643e09-31e0-4152-9874-b59a9c1f0581 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:38.732524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6d643e09-31e0-4152-9874-b59a9c1f0581 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:38.762325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6d643e09-31e0-4152-9874-b59a9c1f0581 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042909 Jan 15 15:57:38.762886 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 491/976] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:39.773391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-58780400-b021-4039-9ba5-7e8cf4eab862 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:39.774306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-58780400-b021-4039-9ba5-7e8cf4eab862 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:39.781513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58780400-b021-4039-9ba5-7e8cf4eab862 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:39.781980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58780400-b021-4039-9ba5-7e8cf4eab862 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:39.782764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58780400-b021-4039-9ba5-7e8cf4eab862 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:39.783203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58780400-b021-4039-9ba5-7e8cf4eab862 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:39.813106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-58780400-b021-4039-9ba5-7e8cf4eab862 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Jan 15 15:57:39.813669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 486/977] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:40.824408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-75d224ee-7f76-49cd-a2cf-6033cc1d6f22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:40.825347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-75d224ee-7f76-49cd-a2cf-6033cc1d6f22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:40.831368 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d224ee-7f76-49cd-a2cf-6033cc1d6f22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:40.831885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d224ee-7f76-49cd-a2cf-6033cc1d6f22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:40.832781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d224ee-7f76-49cd-a2cf-6033cc1d6f22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:40.833214 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d224ee-7f76-49cd-a2cf-6033cc1d6f22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:40.863049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-75d224ee-7f76-49cd-a2cf-6033cc1d6f22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 Jan 15 15:57:40.863615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 492/978] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:41.874812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-41b57e46-f812-46db-93fd-722a08c0bfd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:41.875515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-41b57e46-f812-46db-93fd-722a08c0bfd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:41.881815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41b57e46-f812-46db-93fd-722a08c0bfd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:41.882275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41b57e46-f812-46db-93fd-722a08c0bfd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:41.883069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41b57e46-f812-46db-93fd-722a08c0bfd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:41.883512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-41b57e46-f812-46db-93fd-722a08c0bfd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:41.913272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-41b57e46-f812-46db-93fd-722a08c0bfd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jan 15 15:57:41.913772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 487/979] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:42.923944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2f30ff28-60e0-408b-b82a-c844e3f6f635 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:42.924898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2f30ff28-60e0-408b-b82a-c844e3f6f635 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:42.931095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f30ff28-60e0-408b-b82a-c844e3f6f635 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:42.931575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f30ff28-60e0-408b-b82a-c844e3f6f635 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:42.932488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f30ff28-60e0-408b-b82a-c844e3f6f635 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:42.933719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2f30ff28-60e0-408b-b82a-c844e3f6f635 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:42.963902 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2f30ff28-60e0-408b-b82a-c844e3f6f635 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Jan 15 15:57:42.964489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 493/980] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:43.974571 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-17c9f4ca-d20e-4ac7-bf16-7d7e0bcff7a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:43.975492 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-17c9f4ca-d20e-4ac7-bf16-7d7e0bcff7a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:43.981956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c9f4ca-d20e-4ac7-bf16-7d7e0bcff7a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:43.982412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c9f4ca-d20e-4ac7-bf16-7d7e0bcff7a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:43.983198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c9f4ca-d20e-4ac7-bf16-7d7e0bcff7a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:43.983637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17c9f4ca-d20e-4ac7-bf16-7d7e0bcff7a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:44.012619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-17c9f4ca-d20e-4ac7-bf16-7d7e0bcff7a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Jan 15 15:57:44.013317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 488/981] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:45.023798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-de129bc5-29fe-4776-862a-38d906473102 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:45.024795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-de129bc5-29fe-4776-862a-38d906473102 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:45.032521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de129bc5-29fe-4776-862a-38d906473102 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:45.032970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de129bc5-29fe-4776-862a-38d906473102 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:45.033786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de129bc5-29fe-4776-862a-38d906473102 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:45.034223 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de129bc5-29fe-4776-862a-38d906473102 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:45.063912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-de129bc5-29fe-4776-862a-38d906473102 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Jan 15 15:57:45.067609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 494/982] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:46.075295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-729e67c5-306d-4e70-a8cc-8009bba5ebcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:46.076328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-729e67c5-306d-4e70-a8cc-8009bba5ebcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:46.082569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-729e67c5-306d-4e70-a8cc-8009bba5ebcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:46.083114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-729e67c5-306d-4e70-a8cc-8009bba5ebcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:46.083972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-729e67c5-306d-4e70-a8cc-8009bba5ebcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:46.084521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-729e67c5-306d-4e70-a8cc-8009bba5ebcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:46.115043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-729e67c5-306d-4e70-a8cc-8009bba5ebcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Jan 15 15:57:46.115603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 489/983] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:47.127103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3f27cd3c-73d7-4d57-aa4b-69ade5c8d945 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:47.127948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3f27cd3c-73d7-4d57-aa4b-69ade5c8d945 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:47.134406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f27cd3c-73d7-4d57-aa4b-69ade5c8d945 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:47.134854 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f27cd3c-73d7-4d57-aa4b-69ade5c8d945 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:47.135637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f27cd3c-73d7-4d57-aa4b-69ade5c8d945 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:47.136127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f27cd3c-73d7-4d57-aa4b-69ade5c8d945 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:47.168834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3f27cd3c-73d7-4d57-aa4b-69ade5c8d945 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046105 Jan 15 15:57:47.169462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 495/984] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:48.180193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8fdeb8e2-d426-4217-a264-5faefb5825de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:48.181116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8fdeb8e2-d426-4217-a264-5faefb5825de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:48.188035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8fdeb8e2-d426-4217-a264-5faefb5825de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:48.188525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8fdeb8e2-d426-4217-a264-5faefb5825de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:48.189319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8fdeb8e2-d426-4217-a264-5faefb5825de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:48.189760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8fdeb8e2-d426-4217-a264-5faefb5825de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:48.219212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8fdeb8e2-d426-4217-a264-5faefb5825de tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042699 Jan 15 15:57:48.222988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 490/985] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:49.230398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c4d8bbe5-0ec0-4408-9304-21cb4f17fd3b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:49.231315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c4d8bbe5-0ec0-4408-9304-21cb4f17fd3b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:49.237833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4d8bbe5-0ec0-4408-9304-21cb4f17fd3b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:49.238290 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4d8bbe5-0ec0-4408-9304-21cb4f17fd3b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:49.239087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4d8bbe5-0ec0-4408-9304-21cb4f17fd3b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:49.239606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4d8bbe5-0ec0-4408-9304-21cb4f17fd3b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:49.268838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c4d8bbe5-0ec0-4408-9304-21cb4f17fd3b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042305 Jan 15 15:57:49.269402 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 496/986] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:50.281014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-566c1ef3-beb9-4554-8aad-2d228f7a8ad5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:50.281970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-566c1ef3-beb9-4554-8aad-2d228f7a8ad5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:50.287841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-566c1ef3-beb9-4554-8aad-2d228f7a8ad5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:50.288354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-566c1ef3-beb9-4554-8aad-2d228f7a8ad5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:50.289196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-566c1ef3-beb9-4554-8aad-2d228f7a8ad5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:50.289589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-566c1ef3-beb9-4554-8aad-2d228f7a8ad5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:50.318692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-566c1ef3-beb9-4554-8aad-2d228f7a8ad5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jan 15 15:57:50.319239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 491/987] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:51.329666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b0db2e23-7b49-4338-91ae-7f42f6772c03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:51.330580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b0db2e23-7b49-4338-91ae-7f42f6772c03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:51.336925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0db2e23-7b49-4338-91ae-7f42f6772c03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:51.337372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0db2e23-7b49-4338-91ae-7f42f6772c03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:51.338159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0db2e23-7b49-4338-91ae-7f42f6772c03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:51.338593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0db2e23-7b49-4338-91ae-7f42f6772c03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:51.367731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b0db2e23-7b49-4338-91ae-7f42f6772c03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 Jan 15 15:57:51.368311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 497/988] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:52.378506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-dd036a47-d3dd-4ab6-b507-6c5b7cfc69e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:52.379426 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-dd036a47-d3dd-4ab6-b507-6c5b7cfc69e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:52.386358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd036a47-d3dd-4ab6-b507-6c5b7cfc69e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:52.386832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd036a47-d3dd-4ab6-b507-6c5b7cfc69e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:52.387782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd036a47-d3dd-4ab6-b507-6c5b7cfc69e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:52.388251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd036a47-d3dd-4ab6-b507-6c5b7cfc69e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:52.416883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-dd036a47-d3dd-4ab6-b507-6c5b7cfc69e7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 Jan 15 15:57:52.417435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 492/989] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:53.427415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9b98aeab-a30a-4fde-ac13-68328d57dc7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:53.428909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9b98aeab-a30a-4fde-ac13-68328d57dc7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:53.435681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b98aeab-a30a-4fde-ac13-68328d57dc7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:53.436130 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b98aeab-a30a-4fde-ac13-68328d57dc7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:53.437005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b98aeab-a30a-4fde-ac13-68328d57dc7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:53.437362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b98aeab-a30a-4fde-ac13-68328d57dc7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:53.466500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9b98aeab-a30a-4fde-ac13-68328d57dc7d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 Jan 15 15:57:53.467044 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 498/990] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:54.477533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1ec5fb2f-a663-48ff-a78b-1943d29deb6a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:54.478452 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1ec5fb2f-a663-48ff-a78b-1943d29deb6a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:54.484968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ec5fb2f-a663-48ff-a78b-1943d29deb6a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:54.485426 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ec5fb2f-a663-48ff-a78b-1943d29deb6a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:54.486208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ec5fb2f-a663-48ff-a78b-1943d29deb6a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:54.486714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ec5fb2f-a663-48ff-a78b-1943d29deb6a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:54.515868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1ec5fb2f-a663-48ff-a78b-1943d29deb6a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042050 Jan 15 15:57:54.516467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 493/991] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:55.527267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5518aca0-2e54-478e-93c4-9fe05c189b31 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:55.528253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5518aca0-2e54-478e-93c4-9fe05c189b31 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:55.537001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5518aca0-2e54-478e-93c4-9fe05c189b31 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:55.537448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5518aca0-2e54-478e-93c4-9fe05c189b31 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:55.538238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5518aca0-2e54-478e-93c4-9fe05c189b31 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:55.538759 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5518aca0-2e54-478e-93c4-9fe05c189b31 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:55.570284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5518aca0-2e54-478e-93c4-9fe05c189b31 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047148 Jan 15 15:57:55.570868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 499/992] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:56.582418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6174221a-54b8-473d-be97-ca4a632ae4ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:56.583338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6174221a-54b8-473d-be97-ca4a632ae4ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:56.589773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6174221a-54b8-473d-be97-ca4a632ae4ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:56.590234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6174221a-54b8-473d-be97-ca4a632ae4ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:56.591028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6174221a-54b8-473d-be97-ca4a632ae4ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:56.591472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6174221a-54b8-473d-be97-ca4a632ae4ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:56.620928 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6174221a-54b8-473d-be97-ca4a632ae4ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Jan 15 15:57:56.621494 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 494/993] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:57.632331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a7c1c095-f425-4505-992a-4f6dd0d2a814 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:57.633247 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a7c1c095-f425-4505-992a-4f6dd0d2a814 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:57.640405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7c1c095-f425-4505-992a-4f6dd0d2a814 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:57.640859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7c1c095-f425-4505-992a-4f6dd0d2a814 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:57.641635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7c1c095-f425-4505-992a-4f6dd0d2a814 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:57.642072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a7c1c095-f425-4505-992a-4f6dd0d2a814 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:57.670657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a7c1c095-f425-4505-992a-4f6dd0d2a814 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Jan 15 15:57:57.671204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 500/994] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:58.681861 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b2687b2d-c96d-41c1-b0e2-960addd62496 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:58.682792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b2687b2d-c96d-41c1-b0e2-960addd62496 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:58.689082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b2687b2d-c96d-41c1-b0e2-960addd62496 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:58.689542 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b2687b2d-c96d-41c1-b0e2-960addd62496 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:58.690329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b2687b2d-c96d-41c1-b0e2-960addd62496 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:58.690789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b2687b2d-c96d-41c1-b0e2-960addd62496 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:58.720067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b2687b2d-c96d-41c1-b0e2-960addd62496 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 Jan 15 15:57:58.720657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 495/995] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:57:59.731358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a9f1e1a2-a38e-40a2-a46b-432c2688cfcc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:57:59.732292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a9f1e1a2-a38e-40a2-a46b-432c2688cfcc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:57:59.738463 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a9f1e1a2-a38e-40a2-a46b-432c2688cfcc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:59.738908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a9f1e1a2-a38e-40a2-a46b-432c2688cfcc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:59.739676 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a9f1e1a2-a38e-40a2-a46b-432c2688cfcc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:57:59.740109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a9f1e1a2-a38e-40a2-a46b-432c2688cfcc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:57:59.769151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a9f1e1a2-a38e-40a2-a46b-432c2688cfcc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Jan 15 15:57:59.769696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 501/996] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 15:57:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:58:00.453042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:00.453635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:00.459867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:00.460344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:00.461202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:00.461638 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:00.730838 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.objects.instance [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lazy-loading 'services' on Instance uuid 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 {{(pid=123221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:58:00.780593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d57f0cb2-5c0b-499c-aade-4fed2678cca2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:00.781513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d57f0cb2-5c0b-499c-aade-4fed2678cca2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:00.787672 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d57f0cb2-5c0b-499c-aade-4fed2678cca2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:00.788129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d57f0cb2-5c0b-499c-aade-4fed2678cca2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:00.788945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d57f0cb2-5c0b-499c-aade-4fed2678cca2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:00.789383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d57f0cb2-5c0b-499c-aade-4fed2678cca2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:00.866893 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d57f0cb2-5c0b-499c-aade-4fed2678cca2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action" status: 200 len: 87568 microversion: 2.1 time: 0.090099 Jan 15 15:58:00.867544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 502/997] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:58:00 2022] POST /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a/action => generated 87568 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:58:00.963101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5a79d4ba-2a8f-4a76-9553-11e1908685b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0/os-volume_attachments/392f28bd-8dd3-41c8-b0c0-a5b958d7922a" status: 202 len: 0 microversion: 2.1 time: 0.513723 Jan 15 15:58:00.963806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 496/998] 10.222.0.36 () {58 vars in 1415 bytes} [Sat Jan 15 15:58:00 2022] DELETE /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0/os-volume_attachments/392f28bd-8dd3-41c8-b0c0-a5b958d7922a => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:58:17.660210 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:58:17.660901 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 15:58:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:58:24.290781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:58:24.291378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 15:58:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:58:24.313452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 15:58:24.313867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 15:58:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 15:58:29.844916 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:29.845740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:29.852725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:29.853214 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:29.854654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:29.855091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:29.880361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 15:58:30.196489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-833e86da-5e6a-40af-902a-d76e037e680b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 204 len: 0 microversion: 2.20 time: 0.355237 Jan 15 15:58:30.197077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 503/999] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Jan 15 15:58:29 2022] DELETE /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 15:58:30.206608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:30.207308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:30.214864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:30.215320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:30.216106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:30.216583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:30.344337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:30.351972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:30.353497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:30.355051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c931c030-395e-4971-bbcf-8772be373e3b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1723 microversion: 2.20 time: 0.153140 Jan 15 15:58:30.355633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 497/1000] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:30 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:31.373959 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:31.374786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:31.381940 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:31.382376 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:31.383170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:31.383585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:31.620628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:31.628465 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:31.629979 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:31.631133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b8357454-2d5e-4b51-bc26-767e700319d1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1723 microversion: 2.20 time: 0.261692 Jan 15 15:58:31.631690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 504/1001] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:31 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:32.177604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-d035f04f-a053-4bec-b3c4-bb8d881bfffd req-6671eee9-de55-4a6a-9faf-3e5670796f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62b0ad3-733e-4543-8395-a9ebb0de6702", "name": "network-vif-deleted", "tag": "c57c6f6f-54d0-451c-936b-073bd33f289b"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:32.179268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:58:32.179268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:58:32.186987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-d035f04f-a053-4bec-b3c4-bb8d881bfffd req-6671eee9-de55-4a6a-9faf-3e5670796f33 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:32.194308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-d035f04f-a053-4bec-b3c4-bb8d881bfffd req-6671eee9-de55-4a6a-9faf-3e5670796f33 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:32.199238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-d035f04f-a053-4bec-b3c4-bb8d881bfffd req-6671eee9-de55-4a6a-9faf-3e5670796f33 service nova] Creating event network-vif-deleted:c57c6f6f-54d0-451c-936b-073bd33f289b for instance a62b0ad3-733e-4543-8395-a9ebb0de6702 on hv-cinder-82481 Jan 15 15:58:32.204358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-d035f04f-a053-4bec-b3c4-bb8d881bfffd req-6671eee9-de55-4a6a-9faf-3e5670796f33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102610 Jan 15 15:58:32.204961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 498/1002] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:58:32.650242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:32.652010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:32.659096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:32.660103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:32.661109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:32.661750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:32.695067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:32.695864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:32.696336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lazy-loading 'fault' on Instance uuid a62b0ad3-733e-4543-8395-a9ebb0de6702 {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:58:32.746188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:32.756478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:32.758545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:32.759937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ee47a892-579a-4a2d-91af-493f27a902ef tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 200 len: 1371 microversion: 2.20 time: 0.113220 Jan 15 15:58:32.764683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 505/1003] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:32 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:33.780034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:33.780769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:33.786771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:33.787229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:33.788021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:33.788504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:33.804122 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] HTTP exception thrown: Instance a62b0ad3-733e-4543-8395-a9ebb0de6702 could not be found. Jan 15 15:58:33.807787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Returning 404 to user: Instance a62b0ad3-733e-4543-8395-a9ebb0de6702 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:58:33.807787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fdfc5936-9462-4872-b969-744d8b9977f4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 404 len: 111 microversion: 2.20 time: 0.030712 Jan 15 15:58:33.807787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 499/1004] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:33 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 15:58:33.815698 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a0c2f9be-fec9-4c9b-a90e-adc7f58defb7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '.version_select at 0x7f2163693160>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:33.911765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a0c2f9be-fec9-4c9b-a90e-adc7f58defb7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283530342" status: 204 len: 0 microversion: 2.20 time: 0.099906 Jan 15 15:58:33.912636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 506/1005] 10.222.0.36 () {60 vars in 1258 bytes} [Sat Jan 15 15:58:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283530342 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 15:58:34.873182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-56b5e89e-c825-49d0-b286-1910ddb3dce7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'create', calling method: .version_select at 0x7f21636e4af0>, body: {"keypair": {"name": "tempest-keypair-268881886"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:34.888174 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-56b5e89e-c825-49d0-b286-1910ddb3dce7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:58:34.891952 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-56b5e89e-c825-49d0-b286-1910ddb3dce7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for user 36b1f031a12243b59ef309631e015afb and project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:58:35.063713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-56b5e89e-c825-49d0-b286-1910ddb3dce7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:58:35.067225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-56b5e89e-c825-49d0-b286-1910ddb3dce7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for user 36b1f031a12243b59ef309631e015afb and project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:58:35.079808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-56b5e89e-c825-49d0-b286-1910ddb3dce7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.210914 Jan 15 15:58:35.080601 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 500/1006] 10.222.0.36 () {62 vars in 1198 bytes} [Sat Jan 15 15:58:34 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 212 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 15 15:58:37.354021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1937137960", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba917754-41da-43a8-bbd2-12e267fa8e32"}], "security_groups": [{"name": "tempest-securitygroup--228595543"}], "key_name": "tempest-keypair-268881886", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:37.462830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] validate_networks() for [('ba917754-41da-43a8-bbd2-12e267fa8e32', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:58:37.881431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:58:37.881853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:58:37.882355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:58:37.882945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:58:37.883363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:58:37.892266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:37.892717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:37.893527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:37.893955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:37.911452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:58:37.915536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Getting quotas for user 36b1f031a12243b59ef309631e015afb and project c0ac4f4ac1e34126997c44b68ff5c47b. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:58:37.926837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:58:37.929164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:58:38.050867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-de071cc1-9fbd-4c3c-807e-ac028ab41817 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.701354 Jan 15 15:58:38.051507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 507/1007] 10.222.0.36 () {62 vars in 1187 bytes} [Sat Jan 15 15:58:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 15:58:38.062850 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-258e67ba-15b1-4f40-b6f4-289d1fd695df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:38.063458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-258e67ba-15b1-4f40-b6f4-289d1fd695df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:38.120790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-258e67ba-15b1-4f40-b6f4-289d1fd695df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:38.127791 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-258e67ba-15b1-4f40-b6f4-289d1fd695df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:38.129551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-258e67ba-15b1-4f40-b6f4-289d1fd695df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:38.130653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-258e67ba-15b1-4f40-b6f4-289d1fd695df tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1281 microversion: 2.20 time: 0.072569 Jan 15 15:58:38.131207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 501/1008] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:38 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:39.148988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:39.149610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:39.156617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:39.157077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:39.157900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:39.158343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:39.220579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:39.228331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:39.231712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:39.231712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-142776d9-72e2-466c-893d-c342dbdaac5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1285 microversion: 2.20 time: 0.086281 Jan 15 15:58:39.231712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 508/1009] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:39 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:40.251617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:40.252960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:40.261351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:40.261976 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:40.262778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:40.263222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:40.326844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:40.333871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:40.335366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:40.336491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5ffd8a9a-ce62-473b-8308-42ac46937f02 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1351 microversion: 2.20 time: 0.090695 Jan 15 15:58:40.337045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 502/1010] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:40 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:41.360766 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:41.361376 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:41.367627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:41.368071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:41.368884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:41.369310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:41.504299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:41.512803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:41.514794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:41.516153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9f2162d7-466f-4ad5-9240-21680f87e56f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.159061 Jan 15 15:58:41.517230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 509/1011] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:41 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:41.760900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-86d7d71b-6529-4d3d-ba9f-28eb70d5b47a req-1f34f435-c07d-437e-b511-86debbae1d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7455c9-a827-401c-be13-dde30a246560", "tag": "4fa03a1d-8f3d-4203-9231-350176265ebe"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:41.763463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:58:41.763463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:58:41.772999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-86d7d71b-6529-4d3d-ba9f-28eb70d5b47a req-1f34f435-c07d-437e-b511-86debbae1d8c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:41.773451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-86d7d71b-6529-4d3d-ba9f-28eb70d5b47a req-1f34f435-c07d-437e-b511-86debbae1d8c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:41.788392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-86d7d71b-6529-4d3d-ba9f-28eb70d5b47a req-1f34f435-c07d-437e-b511-86debbae1d8c service nova] Creating event network-changed:4fa03a1d-8f3d-4203-9231-350176265ebe for instance bf7455c9-a827-401c-be13-dde30a246560 on hv-cinder-82481 Jan 15 15:58:41.793381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-86d7d71b-6529-4d3d-ba9f-28eb70d5b47a req-1f34f435-c07d-437e-b511-86debbae1d8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037188 Jan 15 15:58:41.793978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 503/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:58:42.535033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:42.535575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:42.542074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:42.542530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:42.543308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:42.543749 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:42.676972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:42.685331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:42.686831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:42.687927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ce67d2b1-e804-4b39-878a-855c2a55954d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.156689 Jan 15 15:58:42.688534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 510/1013] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:42 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:43.706843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:43.707543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:43.714369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:43.714818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:43.715631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:43.716082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:43.843355 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:43.851328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:43.852886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:43.854028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5a34c1f4-8fab-4e69-9b38-b75148e5ee61 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.151681 Jan 15 15:58:43.854609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 504/1014] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:43 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:44.871566 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:44.872187 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:44.878485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:44.878931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:44.879702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:44.880159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:45.150309 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:45.159208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:45.160732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:45.161826 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-47e719fb-4742-428e-9f45-3217bccaf6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.294001 Jan 15 15:58:45.162361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 511/1015] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:44 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:46.179292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:46.179902 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:46.188564 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:46.189014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:46.189795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:46.190232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:46.321886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:46.330332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:46.331841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:46.332955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-07233dc9-785e-4c24-bb0c-4ef86afbbcc7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.157320 Jan 15 15:58:46.333503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 505/1016] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:46 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:47.350398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:47.351011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:47.357983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:47.358436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:47.359221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:47.359663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:47.489706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:47.500791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:47.502321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:47.503459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-30e18f9f-d42b-4cb0-a671-7f2bd293592c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.156740 Jan 15 15:58:47.503996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 512/1017] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:47 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:48.522240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:48.522676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:48.530483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:48.530963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:48.531704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:48.532156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:48.664323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:48.672935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:48.674365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:48.675470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cbd2cadc-f681-4b9f-a000-60b5c9dc2d18 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.157097 Jan 15 15:58:48.676232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 506/1018] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:48 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:49.694145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:49.694756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:49.701680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:49.702135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:49.702920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:49.703361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:49.832289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:49.840636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:49.842139 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:49.843243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b0f39f5b-549e-4601-8707-2eb2fad4352a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.152864 Jan 15 15:58:49.843790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 513/1019] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:49 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:50.053837 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-94071d04-6fda-4cf6-90bb-5179f635be6c req-c277a0fc-6934-458e-a648-da430733a521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7455c9-a827-401c-be13-dde30a246560", "name": "network-vif-plugged", "status": "completed", "tag": "4fa03a1d-8f3d-4203-9231-350176265ebe"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:50.060260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:58:50.060260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 15:58:50.062317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-94071d04-6fda-4cf6-90bb-5179f635be6c req-c277a0fc-6934-458e-a648-da430733a521 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:50.062763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-94071d04-6fda-4cf6-90bb-5179f635be6c req-c277a0fc-6934-458e-a648-da430733a521 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:50.073201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-94071d04-6fda-4cf6-90bb-5179f635be6c req-c277a0fc-6934-458e-a648-da430733a521 service nova] Creating event network-vif-plugged:4fa03a1d-8f3d-4203-9231-350176265ebe for instance bf7455c9-a827-401c-be13-dde30a246560 on hv-cinder-82481 Jan 15 15:58:50.078155 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-94071d04-6fda-4cf6-90bb-5179f635be6c req-c277a0fc-6934-458e-a648-da430733a521 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083647 Jan 15 15:58:50.078742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 507/1020] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:58:50.860264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:50.860877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:50.867083 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:50.867544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:50.868340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:50.868776 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:50.996322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:51.003956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:51.005506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:51.006618 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dda5fce7-5a36-4026-8474-a47e94c0b524 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1406 microversion: 2.20 time: 0.149971 Jan 15 15:58:51.007159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 514/1021] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:50 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:52.025292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:52.027529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:52.033895 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:52.034531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:52.035322 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:52.035759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:52.169879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:52.177714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:52.179212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:58:52.180393 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d3a93150-fbce-4214-b2e6-720f53b09a9e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1598 microversion: 2.20 time: 0.159885 Jan 15 15:58:52.180943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 508/1022] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 15:58:52 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:58:52.198224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c22c9651-f911-43b5-9581-5c90715160a4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:58:52.198718 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c22c9651-f911-43b5-9581-5c90715160a4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:52.204881 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c22c9651-f911-43b5-9581-5c90715160a4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:52.205331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c22c9651-f911-43b5-9581-5c90715160a4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:52.206127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c22c9651-f911-43b5-9581-5c90715160a4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:52.206545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c22c9651-f911-43b5-9581-5c90715160a4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:52.283584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c22c9651-f911-43b5-9581-5c90715160a4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089516 Jan 15 15:58:52.284207 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 515/1023] 10.222.0.36 () {60 vars in 1315 bytes} [Sat Jan 15 15:58:52 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:58:53.453051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b672c5ab-20f7-4f2a-84a8-555af2ac3b2b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:53.459790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b672c5ab-20f7-4f2a-84a8-555af2ac3b2b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:53.466925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b672c5ab-20f7-4f2a-84a8-555af2ac3b2b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:53.467379 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b672c5ab-20f7-4f2a-84a8-555af2ac3b2b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:53.468319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b672c5ab-20f7-4f2a-84a8-555af2ac3b2b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:53.468669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b672c5ab-20f7-4f2a-84a8-555af2ac3b2b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:53.519972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-ee7acf25-1a9f-420f-8f4f-daa38c0d8d0a req-0360b6d2-30bc-4e83-8fc7-610b257ae7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7455c9-a827-401c-be13-dde30a246560", "tag": "4fa03a1d-8f3d-4203-9231-350176265ebe"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:53.521742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:58:53.521742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:58:53.530245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-ee7acf25-1a9f-420f-8f4f-daa38c0d8d0a req-0360b6d2-30bc-4e83-8fc7-610b257ae7f0 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:53.530703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-ee7acf25-1a9f-420f-8f4f-daa38c0d8d0a req-0360b6d2-30bc-4e83-8fc7-610b257ae7f0 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:53.530837 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b672c5ab-20f7-4f2a-84a8-555af2ac3b2b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.081155 Jan 15 15:58:53.531994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 509/1024] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:58:53 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:58:53.545419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-ee7acf25-1a9f-420f-8f4f-daa38c0d8d0a req-0360b6d2-30bc-4e83-8fc7-610b257ae7f0 service nova] Creating event network-changed:4fa03a1d-8f3d-4203-9231-350176265ebe for instance bf7455c9-a827-401c-be13-dde30a246560 on hv-cinder-82481 Jan 15 15:58:53.550641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-ee7acf25-1a9f-420f-8f4f-daa38c0d8d0a req-0360b6d2-30bc-4e83-8fc7-610b257ae7f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095747 Jan 15 15:58:53.551814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 516/1025] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:58:54.542507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-313deec8-f0cf-47b6-a1d7-af48f82a9f92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:54.543421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-313deec8-f0cf-47b6-a1d7-af48f82a9f92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:54.550340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-313deec8-f0cf-47b6-a1d7-af48f82a9f92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:54.550794 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-313deec8-f0cf-47b6-a1d7-af48f82a9f92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:54.551575 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-313deec8-f0cf-47b6-a1d7-af48f82a9f92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:54.552015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-313deec8-f0cf-47b6-a1d7-af48f82a9f92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:54.610492 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-313deec8-f0cf-47b6-a1d7-af48f82a9f92 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.072602 Jan 15 15:58:54.613664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 510/1026] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:58:54 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 15:58:55.622913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0e916694-3a35-4976-bd6d-f1c821a33d70 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:55.623871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0e916694-3a35-4976-bd6d-f1c821a33d70 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:55.630399 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e916694-3a35-4976-bd6d-f1c821a33d70 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:55.630846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e916694-3a35-4976-bd6d-f1c821a33d70 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:55.631623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e916694-3a35-4976-bd6d-f1c821a33d70 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:55.632054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e916694-3a35-4976-bd6d-f1c821a33d70 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:55.691025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0e916694-3a35-4976-bd6d-f1c821a33d70 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.073068 Jan 15 15:58:55.691785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 517/1027] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:58:55 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:58:56.703127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-00873726-777b-44cf-9beb-7b88aba83622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:56.704124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-00873726-777b-44cf-9beb-7b88aba83622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:56.710826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00873726-777b-44cf-9beb-7b88aba83622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:56.711274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00873726-777b-44cf-9beb-7b88aba83622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:56.712051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00873726-777b-44cf-9beb-7b88aba83622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:56.712507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00873726-777b-44cf-9beb-7b88aba83622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:56.771721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-00873726-777b-44cf-9beb-7b88aba83622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.072678 Jan 15 15:58:56.772391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 511/1028] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:58:56 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:58:57.785852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-93219fad-860c-49f3-9312-d14653bc569e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:57.785852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-93219fad-860c-49f3-9312-d14653bc569e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:57.791731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93219fad-860c-49f3-9312-d14653bc569e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:57.792197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93219fad-860c-49f3-9312-d14653bc569e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:57.792993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93219fad-860c-49f3-9312-d14653bc569e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:57.793455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-93219fad-860c-49f3-9312-d14653bc569e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:57.865495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-93219fad-860c-49f3-9312-d14653bc569e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.086437 Jan 15 15:58:57.866157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 518/1029] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:58:57 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:58:58.876773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d0345e94-ff53-4343-86a2-0c5012d1abbe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:58.877782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d0345e94-ff53-4343-86a2-0c5012d1abbe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:58.885592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0345e94-ff53-4343-86a2-0c5012d1abbe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:58.886087 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0345e94-ff53-4343-86a2-0c5012d1abbe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:58.889907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0345e94-ff53-4343-86a2-0c5012d1abbe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:58.889907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d0345e94-ff53-4343-86a2-0c5012d1abbe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:58.944885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d0345e94-ff53-4343-86a2-0c5012d1abbe tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.071989 Jan 15 15:58:58.945499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 512/1030] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:58:58 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:58:59.956800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c767ffda-6db6-48ea-a871-f64c3a4cdeb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:58:59.957847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c767ffda-6db6-48ea-a871-f64c3a4cdeb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:58:59.965516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c767ffda-6db6-48ea-a871-f64c3a4cdeb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:59.965971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c767ffda-6db6-48ea-a871-f64c3a4cdeb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:58:59.966741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c767ffda-6db6-48ea-a871-f64c3a4cdeb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:58:59.967173 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c767ffda-6db6-48ea-a871-f64c3a4cdeb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:00.024863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c767ffda-6db6-48ea-a871-f64c3a4cdeb6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.072076 Jan 15 15:59:00.026749 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 519/1031] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:58:59 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:01.037010 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-29eb4291-d987-48a9-bd0a-321dd4927c0f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:01.038028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-29eb4291-d987-48a9-bd0a-321dd4927c0f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:01.045028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-29eb4291-d987-48a9-bd0a-321dd4927c0f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:01.045483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-29eb4291-d987-48a9-bd0a-321dd4927c0f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:01.046278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-29eb4291-d987-48a9-bd0a-321dd4927c0f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:01.046717 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-29eb4291-d987-48a9-bd0a-321dd4927c0f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:01.104046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-29eb4291-d987-48a9-bd0a-321dd4927c0f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.070829 Jan 15 15:59:01.105071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 513/1032] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:01 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:02.115276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-89717846-ad1e-456c-a1ac-2e405b883617 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:02.116301 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-89717846-ad1e-456c-a1ac-2e405b883617 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:02.123971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89717846-ad1e-456c-a1ac-2e405b883617 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:02.124447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89717846-ad1e-456c-a1ac-2e405b883617 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:02.125235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89717846-ad1e-456c-a1ac-2e405b883617 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:02.125667 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89717846-ad1e-456c-a1ac-2e405b883617 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:02.182987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-89717846-ad1e-456c-a1ac-2e405b883617 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.071746 Jan 15 15:59:02.183599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 520/1033] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:02 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:03.194238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-abd6868f-2ef6-4aac-8152-7543298b3c11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:03.195287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-abd6868f-2ef6-4aac-8152-7543298b3c11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:03.202465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abd6868f-2ef6-4aac-8152-7543298b3c11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:03.202915 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abd6868f-2ef6-4aac-8152-7543298b3c11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:03.203701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abd6868f-2ef6-4aac-8152-7543298b3c11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:03.204160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abd6868f-2ef6-4aac-8152-7543298b3c11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:03.263540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-abd6868f-2ef6-4aac-8152-7543298b3c11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 14 microversion: 2.20 time: 0.073228 Jan 15 15:59:03.264170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 514/1034] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:03 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:04.274524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ddd6f7d6-5103-404b-b0ad-094730a21858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:04.275584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ddd6f7d6-5103-404b-b0ad-094730a21858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:04.282650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ddd6f7d6-5103-404b-b0ad-094730a21858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:04.283044 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ddd6f7d6-5103-404b-b0ad-094730a21858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:04.283816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ddd6f7d6-5103-404b-b0ad-094730a21858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:04.284282 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ddd6f7d6-5103-404b-b0ad-094730a21858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:04.353754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ddd6f7d6-5103-404b-b0ad-094730a21858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 6748 microversion: 2.20 time: 0.083051 Jan 15 15:59:04.354470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 521/1035] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:04 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 6748 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 15:59:05.365121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b66f2cbc-40c9-41b7-bc91-cfee90d42d45 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:05.366121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b66f2cbc-40c9-41b7-bc91-cfee90d42d45 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:05.373663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b66f2cbc-40c9-41b7-bc91-cfee90d42d45 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:05.374115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b66f2cbc-40c9-41b7-bc91-cfee90d42d45 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:05.374898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b66f2cbc-40c9-41b7-bc91-cfee90d42d45 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:05.375341 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b66f2cbc-40c9-41b7-bc91-cfee90d42d45 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:05.446167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b66f2cbc-40c9-41b7-bc91-cfee90d42d45 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 15025 microversion: 2.20 time: 0.084899 Jan 15 15:59:05.446875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 515/1036] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:05 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 15025 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:06.457868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7cce4f4b-72e1-4e75-bb50-ba6af78314ff tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:06.458872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7cce4f4b-72e1-4e75-bb50-ba6af78314ff tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:06.466376 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7cce4f4b-72e1-4e75-bb50-ba6af78314ff tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:06.466834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7cce4f4b-72e1-4e75-bb50-ba6af78314ff tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:06.467628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7cce4f4b-72e1-4e75-bb50-ba6af78314ff tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:06.468079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7cce4f4b-72e1-4e75-bb50-ba6af78314ff tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:06.535637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7cce4f4b-72e1-4e75-bb50-ba6af78314ff tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 18561 microversion: 2.20 time: 0.081657 Jan 15 15:59:06.536284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 522/1037] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:06 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 18561 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:07.547297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b97ae7db-6348-4b45-bc96-4ccc07d3afd0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:07.548336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b97ae7db-6348-4b45-bc96-4ccc07d3afd0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:07.555141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b97ae7db-6348-4b45-bc96-4ccc07d3afd0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:07.555586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b97ae7db-6348-4b45-bc96-4ccc07d3afd0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:07.556929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b97ae7db-6348-4b45-bc96-4ccc07d3afd0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:07.557442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b97ae7db-6348-4b45-bc96-4ccc07d3afd0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:07.631828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b97ae7db-6348-4b45-bc96-4ccc07d3afd0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 20074 microversion: 2.20 time: 0.088530 Jan 15 15:59:07.632598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 516/1038] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:07 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 20074 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:08.642908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-782ca682-4de8-4442-83bf-eb08fed72bae tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:08.643903 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-782ca682-4de8-4442-83bf-eb08fed72bae tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:08.651553 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782ca682-4de8-4442-83bf-eb08fed72bae tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:08.652004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782ca682-4de8-4442-83bf-eb08fed72bae tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:08.652810 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782ca682-4de8-4442-83bf-eb08fed72bae tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:08.653507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782ca682-4de8-4442-83bf-eb08fed72bae tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:08.721151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-782ca682-4de8-4442-83bf-eb08fed72bae tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 22716 microversion: 2.20 time: 0.082136 Jan 15 15:59:08.721764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 523/1039] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:08 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 22716 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:09.733554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c56634b9-8c53-4cd7-bd97-485af3ae2433 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:09.734558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c56634b9-8c53-4cd7-bd97-485af3ae2433 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:09.741421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c56634b9-8c53-4cd7-bd97-485af3ae2433 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:09.741874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c56634b9-8c53-4cd7-bd97-485af3ae2433 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:09.742665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c56634b9-8c53-4cd7-bd97-485af3ae2433 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:09.743107 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c56634b9-8c53-4cd7-bd97-485af3ae2433 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:09.817404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c56634b9-8c53-4cd7-bd97-485af3ae2433 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 23804 microversion: 2.20 time: 0.087767 Jan 15 15:59:09.818228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 517/1040] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:09 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 23804 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:10.829178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8cfdd6dd-a06b-4eb3-9dfc-3375f26330ec tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:10.830176 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8cfdd6dd-a06b-4eb3-9dfc-3375f26330ec tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:10.836942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cfdd6dd-a06b-4eb3-9dfc-3375f26330ec tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:10.837573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cfdd6dd-a06b-4eb3-9dfc-3375f26330ec tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:10.838559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cfdd6dd-a06b-4eb3-9dfc-3375f26330ec tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:10.839002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cfdd6dd-a06b-4eb3-9dfc-3375f26330ec tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:10.922821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8cfdd6dd-a06b-4eb3-9dfc-3375f26330ec tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 25454 microversion: 2.20 time: 0.097581 Jan 15 15:59:10.923468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 524/1041] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:10 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 25454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:11.935563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e26a141e-4ded-4d29-a80d-972aa5827c5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:11.936530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e26a141e-4ded-4d29-a80d-972aa5827c5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:11.943262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26a141e-4ded-4d29-a80d-972aa5827c5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:11.943710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26a141e-4ded-4d29-a80d-972aa5827c5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:11.944539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26a141e-4ded-4d29-a80d-972aa5827c5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:11.944977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26a141e-4ded-4d29-a80d-972aa5827c5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:12.020339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e26a141e-4ded-4d29-a80d-972aa5827c5c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 26790 microversion: 2.20 time: 0.089529 Jan 15 15:59:12.020958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 518/1042] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:11 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 26790 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:13.032976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bdabc5f4-700e-479c-917a-f2ba03e2238e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:13.033897 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bdabc5f4-700e-479c-917a-f2ba03e2238e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:13.040040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdabc5f4-700e-479c-917a-f2ba03e2238e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:13.041446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdabc5f4-700e-479c-917a-f2ba03e2238e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:13.042244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdabc5f4-700e-479c-917a-f2ba03e2238e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:13.042680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bdabc5f4-700e-479c-917a-f2ba03e2238e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:13.119950 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bdabc5f4-700e-479c-917a-f2ba03e2238e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 27671 microversion: 2.20 time: 0.090993 Jan 15 15:59:13.120611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 525/1043] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:13 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 27671 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:14.131159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-addfae38-d583-400e-9044-69b419b79c7d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:14.132177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-addfae38-d583-400e-9044-69b419b79c7d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:14.139209 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-addfae38-d583-400e-9044-69b419b79c7d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:14.139669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-addfae38-d583-400e-9044-69b419b79c7d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:14.140488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-addfae38-d583-400e-9044-69b419b79c7d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:14.140936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-addfae38-d583-400e-9044-69b419b79c7d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:14.219417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-addfae38-d583-400e-9044-69b419b79c7d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28031 microversion: 2.20 time: 0.092191 Jan 15 15:59:14.220053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 519/1044] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:14 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28031 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:15.052004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:15.052793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:15.060121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:15.060612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:15.061389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:15.061829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:15.086142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 15:59:15.232059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-306eb91d-b311-4fe0-8e01-a74acd958e5e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:15.233181 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-306eb91d-b311-4fe0-8e01-a74acd958e5e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:15.239945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-306eb91d-b311-4fe0-8e01-a74acd958e5e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:15.240442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-306eb91d-b311-4fe0-8e01-a74acd958e5e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:15.241765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-306eb91d-b311-4fe0-8e01-a74acd958e5e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:15.241765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-306eb91d-b311-4fe0-8e01-a74acd958e5e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:15.317638 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-306eb91d-b311-4fe0-8e01-a74acd958e5e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.090014 Jan 15 15:59:15.318215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 520/1045] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:15 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:59:15.347432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-60aef225-3f43-47e9-aa68-7f07a307000f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 204 len: 0 microversion: 2.1 time: 0.299152 Jan 15 15:59:15.348038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 526/1046] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 15:59:15 2022] DELETE /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 15:59:15.357526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:15.357823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:15.364077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:15.364565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:15.365352 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:15.365796 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:15.497289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:15.504989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-892a8a45-2025-4e96-8c5a-2eaf608cbdb1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1675 microversion: 2.1 time: 0.152679 Jan 15 15:59:15.505550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 521/1047] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:15 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:16.330435 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dfdf6708-e43f-4e8f-8eba-a855cfe9b8e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:16.331444 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dfdf6708-e43f-4e8f-8eba-a855cfe9b8e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:16.338561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dfdf6708-e43f-4e8f-8eba-a855cfe9b8e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:16.339014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dfdf6708-e43f-4e8f-8eba-a855cfe9b8e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:16.339806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dfdf6708-e43f-4e8f-8eba-a855cfe9b8e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:16.340286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dfdf6708-e43f-4e8f-8eba-a855cfe9b8e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:16.403990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dfdf6708-e43f-4e8f-8eba-a855cfe9b8e0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.077488 Jan 15 15:59:16.407808 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 527/1048] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:16 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:16.522663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:16.523219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:16.529760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:16.530218 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:16.530999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:16.531435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:16.667206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:16.673604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-08ed8b24-88a6-4ca9-9e49-6151d9890d16 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1675 microversion: 2.1 time: 0.154657 Jan 15 15:59:16.674432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 522/1049] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:16 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:17.094529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-fdfe7e02-e8ac-4d01-9c46-16e8da700af0 req-ac0266a6-bbcc-4749-b5c1-0c6f15100ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78be13e2-d439-46ac-9d73-637377b4af0c", "name": "network-vif-deleted", "tag": "09a51e61-e1d7-4c3b-b0ea-5787e051a8e9"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:17.096030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:59:17.096030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:59:17.104427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-fdfe7e02-e8ac-4d01-9c46-16e8da700af0 req-ac0266a6-bbcc-4749-b5c1-0c6f15100ce7 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:17.104894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-fdfe7e02-e8ac-4d01-9c46-16e8da700af0 req-ac0266a6-bbcc-4749-b5c1-0c6f15100ce7 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:17.115781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-fdfe7e02-e8ac-4d01-9c46-16e8da700af0 req-ac0266a6-bbcc-4749-b5c1-0c6f15100ce7 service nova] Creating event network-vif-deleted:09a51e61-e1d7-4c3b-b0ea-5787e051a8e9 for instance 78be13e2-d439-46ac-9d73-637377b4af0c on hv-cinder-82481 Jan 15 15:59:17.121196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-fdfe7e02-e8ac-4d01-9c46-16e8da700af0 req-ac0266a6-bbcc-4749-b5c1-0c6f15100ce7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030655 Jan 15 15:59:17.121791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 528/1050] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:59:17.416506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-97fb6a10-2abf-414d-8d9d-22b788099f4e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:17.417428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-97fb6a10-2abf-414d-8d9d-22b788099f4e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:17.423972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97fb6a10-2abf-414d-8d9d-22b788099f4e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:17.424464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97fb6a10-2abf-414d-8d9d-22b788099f4e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:17.425261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97fb6a10-2abf-414d-8d9d-22b788099f4e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:17.425701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97fb6a10-2abf-414d-8d9d-22b788099f4e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:17.500024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-97fb6a10-2abf-414d-8d9d-22b788099f4e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.087933 Jan 15 15:59:17.502748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 523/1051] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:17 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:17.691627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:17.692492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:17.700560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:17.701126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:17.702032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:17.702600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:17.736922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:17.737472 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:17.738002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lazy-loading 'fault' on Instance uuid 78be13e2-d439-46ac-9d73-637377b4af0c {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 15:59:17.781412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:17.789572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-921266d1-245c-4373-a77e-efc9b0bff124 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 200 len: 1328 microversion: 2.1 time: 0.102349 Jan 15 15:59:17.790197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 529/1052] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:17 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:18.516433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9a26b239-f587-4d3d-99ca-993030054634 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:18.517387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9a26b239-f587-4d3d-99ca-993030054634 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:18.524190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a26b239-f587-4d3d-99ca-993030054634 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:18.525182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a26b239-f587-4d3d-99ca-993030054634 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:18.526117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a26b239-f587-4d3d-99ca-993030054634 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:18.526560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a26b239-f587-4d3d-99ca-993030054634 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:18.586071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9a26b239-f587-4d3d-99ca-993030054634 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.073735 Jan 15 15:59:18.586694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 524/1053] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:18 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:18.809329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:18.810072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:18.816433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:18.816889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:18.817678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:18.818121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:18.831406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] HTTP exception thrown: Instance 78be13e2-d439-46ac-9d73-637377b4af0c could not be found. Jan 15 15:59:18.832000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Returning 404 to user: Instance 78be13e2-d439-46ac-9d73-637377b4af0c could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 15:59:18.832850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ad80f19e-310c-4475-8d33-97e7021bb413 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 404 len: 111 microversion: 2.1 time: 0.027293 Jan 15 15:59:18.833383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 530/1054] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:18 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 15:59:18.842710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a6f02fc8-8d59-4085-845b-0e5f8a1d4064 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '.version_select at 0x7f2163654700>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:18.926019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a6f02fc8-8d59-4085-845b-0e5f8a1d4064 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969789977" status: 202 len: 0 microversion: 2.1 time: 0.087125 Jan 15 15:59:18.926602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 525/1055] 10.222.0.36 () {58 vars in 1220 bytes} [Sat Jan 15 15:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969789977 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:19.597678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ab1bcabe-08ce-4e04-bd82-67a7324f7f59 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:19.598514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ab1bcabe-08ce-4e04-bd82-67a7324f7f59 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:19.605990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab1bcabe-08ce-4e04-bd82-67a7324f7f59 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:19.606438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab1bcabe-08ce-4e04-bd82-67a7324f7f59 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:19.607221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab1bcabe-08ce-4e04-bd82-67a7324f7f59 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:19.607651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab1bcabe-08ce-4e04-bd82-67a7324f7f59 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:19.668980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ab1bcabe-08ce-4e04-bd82-67a7324f7f59 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.074873 Jan 15 15:59:19.670006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 531/1056] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:19 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:19.762028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5fadd24c-57c5-420e-ad11-df293af5e314 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'create', calling method: .version_select at 0x7f21636ec700>, body: {"keypair": {"name": "tempest-keypair-1562003703"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:19.776539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-5fadd24c-57c5-420e-ad11-df293af5e314 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:59:19.780595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-5fadd24c-57c5-420e-ad11-df293af5e314 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for user 9a3bb74802b3408290f26c129388df24 and project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:59:20.065904 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-5fadd24c-57c5-420e-ad11-df293af5e314 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:59:20.069654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-5fadd24c-57c5-420e-ad11-df293af5e314 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for user 9a3bb74802b3408290f26c129388df24 and project 82a446d233d547a699dcdbde99a35548. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:59:20.082843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5fadd24c-57c5-420e-ad11-df293af5e314 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.325865 Jan 15 15:59:20.083423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 526/1057] 10.222.0.36 () {60 vars in 1157 bytes} [Sat Jan 15 15:59:19 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:20.682089 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1b99f4ce-0a8b-4537-8cbd-2c851b03db99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:20.683091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1b99f4ce-0a8b-4537-8cbd-2c851b03db99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:20.690072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b99f4ce-0a8b-4537-8cbd-2c851b03db99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:20.690568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b99f4ce-0a8b-4537-8cbd-2c851b03db99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:20.691354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b99f4ce-0a8b-4537-8cbd-2c851b03db99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:20.691843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b99f4ce-0a8b-4537-8cbd-2c851b03db99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:20.752975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1b99f4ce-0a8b-4537-8cbd-2c851b03db99 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.075196 Jan 15 15:59:20.753600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 532/1058] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:20 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:21.765450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3e22cb56-8afc-429a-b2f6-704a3fa79c8c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:21.766631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3e22cb56-8afc-429a-b2f6-704a3fa79c8c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:21.773495 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e22cb56-8afc-429a-b2f6-704a3fa79c8c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:21.773958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e22cb56-8afc-429a-b2f6-704a3fa79c8c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:21.774787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e22cb56-8afc-429a-b2f6-704a3fa79c8c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:21.775817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e22cb56-8afc-429a-b2f6-704a3fa79c8c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:21.837183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3e22cb56-8afc-429a-b2f6-704a3fa79c8c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.075757 Jan 15 15:59:21.838593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 527/1059] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:21 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:22.449865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1412495684", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16a29c0f-c588-4e7a-a028-57bd992799fc"}], "security_groups": [{"name": "tempest-securitygroup--1133816465"}], "key_name": "tempest-keypair-1562003703", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:22.550043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] validate_networks() for [('16a29c0f-c588-4e7a-a028-57bd992799fc', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 15:59:22.849587 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cd85b8cb-412f-4865-a8a1-af8055e887a0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:22.850591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cd85b8cb-412f-4865-a8a1-af8055e887a0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:22.857623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd85b8cb-412f-4865-a8a1-af8055e887a0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:22.858086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd85b8cb-412f-4865-a8a1-af8055e887a0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:22.858881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd85b8cb-412f-4865-a8a1-af8055e887a0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:22.859329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cd85b8cb-412f-4865-a8a1-af8055e887a0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:22.900900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 15:59:22.901377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 15:59:22.901792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 15:59:22.902195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 15:59:22.902599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 15:59:22.911299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:22.911743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:22.912591 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:22.913024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:22.929784 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for project 82a446d233d547a699dcdbde99a35548. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 15:59:22.933997 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Getting quotas for user 9a3bb74802b3408290f26c129388df24 and project 82a446d233d547a699dcdbde99a35548. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 15:59:22.942064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cd85b8cb-412f-4865-a8a1-af8055e887a0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.096393 Jan 15 15:59:22.943609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 528/1060] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:22 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:59:22.946032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 15:59:22.949133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 15:59:23.083526 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9efd2986-a06d-4315-a532-51dd4a8f7978 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637755 Jan 15 15:59:23.084295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 533/1061] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 15:59:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 15:59:23.095364 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-47ebff3f-72b5-4043-a3f4-49ff3f90c305 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:23.096063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-47ebff3f-72b5-4043-a3f4-49ff3f90c305 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:23.155846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-47ebff3f-72b5-4043-a3f4-49ff3f90c305 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:23.162429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-47ebff3f-72b5-4043-a3f4-49ff3f90c305 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1238 microversion: 2.1 time: 0.071043 Jan 15 15:59:23.163240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 529/1062] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:23 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:23.953967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-530d8289-6e98-489d-89ff-5ebe4605ec11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:23.954933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-530d8289-6e98-489d-89ff-5ebe4605ec11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:23.962110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-530d8289-6e98-489d-89ff-5ebe4605ec11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:23.963183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-530d8289-6e98-489d-89ff-5ebe4605ec11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:23.964066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-530d8289-6e98-489d-89ff-5ebe4605ec11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:23.964523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-530d8289-6e98-489d-89ff-5ebe4605ec11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:24.025897 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-530d8289-6e98-489d-89ff-5ebe4605ec11 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.075060 Jan 15 15:59:24.027031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 534/1063] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:23 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:24.180425 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:24.180960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:24.188081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:24.188572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:24.189353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:24.189923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:24.250035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:24.260169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ce91a618-9dd4-45f0-bf49-e7bf65efb1aa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1234 microversion: 2.1 time: 0.083445 Jan 15 15:59:24.269785 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 530/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:24 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:25.046049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a746eeca-2528-4e59-904f-942b17dbf820 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:25.047177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a746eeca-2528-4e59-904f-942b17dbf820 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:25.054452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a746eeca-2528-4e59-904f-942b17dbf820 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:25.054873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a746eeca-2528-4e59-904f-942b17dbf820 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:25.055675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a746eeca-2528-4e59-904f-942b17dbf820 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:25.056119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a746eeca-2528-4e59-904f-942b17dbf820 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:25.118015 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a746eeca-2528-4e59-904f-942b17dbf820 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.075953 Jan 15 15:59:25.119444 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 535/1065] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:25 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:25.280086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:25.280086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:25.289867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:25.290602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:25.291708 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:25.292330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:25.352833 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:25.360001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-08c6b376-e626-43ee-acbd-a7bac16f62ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1296 microversion: 2.1 time: 0.086837 Jan 15 15:59:25.360611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 531/1066] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:25 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:26.130608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d77aae28-fefa-4aa2-9656-9b854730d3d4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:26.131688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d77aae28-fefa-4aa2-9656-9b854730d3d4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:26.138991 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d77aae28-fefa-4aa2-9656-9b854730d3d4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:26.139440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d77aae28-fefa-4aa2-9656-9b854730d3d4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:26.140436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d77aae28-fefa-4aa2-9656-9b854730d3d4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:26.141026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d77aae28-fefa-4aa2-9656-9b854730d3d4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:26.212004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d77aae28-fefa-4aa2-9656-9b854730d3d4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.085577 Jan 15 15:59:26.213427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 536/1067] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:26 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:59:26.378042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:26.378671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:26.385848 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:26.386690 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:26.388130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:26.388964 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:26.535297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:26.543903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-74457bbc-a877-4406-ad78-2bdf5c71b8fc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.169644 Jan 15 15:59:26.545005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 532/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:26 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:26.685748 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-3f0d3ca8-fee3-4803-b83f-226a0d9f86c7 req-5b59ec90-7041-44fc-8640-bb3f270d96d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f56e96-7f77-4614-9eec-3853f80b7c12", "tag": "f9a8be92-5ef1-4477-bebd-e62518322788"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:26.688458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:59:26.688458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:59:26.696597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-3f0d3ca8-fee3-4803-b83f-226a0d9f86c7 req-5b59ec90-7041-44fc-8640-bb3f270d96d8 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:26.697605 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-3f0d3ca8-fee3-4803-b83f-226a0d9f86c7 req-5b59ec90-7041-44fc-8640-bb3f270d96d8 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:26.711481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-3f0d3ca8-fee3-4803-b83f-226a0d9f86c7 req-5b59ec90-7041-44fc-8640-bb3f270d96d8 service nova] Creating event network-changed:f9a8be92-5ef1-4477-bebd-e62518322788 for instance 15f56e96-7f77-4614-9eec-3853f80b7c12 on hv-cinder-82481 Jan 15 15:59:26.720841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-3f0d3ca8-fee3-4803-b83f-226a0d9f86c7 req-5b59ec90-7041-44fc-8640-bb3f270d96d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039279 Jan 15 15:59:26.724575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 537/1069] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:59:27.224240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3bec0f1f-d5cd-4726-bc9f-9022fa12888f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:27.225405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3bec0f1f-d5cd-4726-bc9f-9022fa12888f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:27.232307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bec0f1f-d5cd-4726-bc9f-9022fa12888f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:27.232940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bec0f1f-d5cd-4726-bc9f-9022fa12888f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:27.233531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bec0f1f-d5cd-4726-bc9f-9022fa12888f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:27.234130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bec0f1f-d5cd-4726-bc9f-9022fa12888f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:27.309538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3bec0f1f-d5cd-4726-bc9f-9022fa12888f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28217 microversion: 2.20 time: 0.088793 Jan 15 15:59:27.310501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 533/1070] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:27 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:27.562817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:27.563437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:27.569558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:27.570000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:27.570768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:27.571199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:27.704452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:27.711668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ffb075af-78ba-458c-9756-0c9fa6ff2503 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.153840 Jan 15 15:59:27.712249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 538/1071] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:27 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:28.321813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-075c1d1e-04f3-4f52-869a-81f427ea0387 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:28.323161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-075c1d1e-04f3-4f52-869a-81f427ea0387 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:28.330560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-075c1d1e-04f3-4f52-869a-81f427ea0387 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:28.331009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-075c1d1e-04f3-4f52-869a-81f427ea0387 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:28.331791 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-075c1d1e-04f3-4f52-869a-81f427ea0387 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:28.332250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-075c1d1e-04f3-4f52-869a-81f427ea0387 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:28.409257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-075c1d1e-04f3-4f52-869a-81f427ea0387 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28508 microversion: 2.20 time: 0.091317 Jan 15 15:59:28.410424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 534/1072] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:28 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28508 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:28.728204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:28.728974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:28.734931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:28.735386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:28.736197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:28.736639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:28.864965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:28.872694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3e1f3223-78bc-4c29-a3a9-bdf5cc93c11c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.148316 Jan 15 15:59:28.873263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 539/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:28 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:29.421102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5027e3b5-8199-4302-8d3e-738303f0d090 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:29.422168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5027e3b5-8199-4302-8d3e-738303f0d090 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:29.430028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5027e3b5-8199-4302-8d3e-738303f0d090 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:29.430517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5027e3b5-8199-4302-8d3e-738303f0d090 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:29.432019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5027e3b5-8199-4302-8d3e-738303f0d090 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:29.432543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5027e3b5-8199-4302-8d3e-738303f0d090 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:29.508034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5027e3b5-8199-4302-8d3e-738303f0d090 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28526 microversion: 2.20 time: 0.090903 Jan 15 15:59:29.508733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 535/1074] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:29 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28526 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:29.889302 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:29.889911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:29.896154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:29.896619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:29.897396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:29.897838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:30.026920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:30.034471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b37d33c9-fc7d-4c57-a0b6-fc26d515f904 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.148828 Jan 15 15:59:30.035053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 540/1075] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:29 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:30.519118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ecd5721f-5853-4636-a067-191026f5b2fb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:30.520742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ecd5721f-5853-4636-a067-191026f5b2fb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:30.531752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd5721f-5853-4636-a067-191026f5b2fb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:30.532238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd5721f-5853-4636-a067-191026f5b2fb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:30.533037 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd5721f-5853-4636-a067-191026f5b2fb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:30.533483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd5721f-5853-4636-a067-191026f5b2fb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:30.612161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ecd5721f-5853-4636-a067-191026f5b2fb tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.096784 Jan 15 15:59:30.612772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 536/1076] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:30 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:31.051595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:31.052237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:31.059302 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:31.059754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:31.060565 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:31.061006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:31.185172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:31.192381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-547ce7fc-73bc-4b95-88a1-a07a3304369b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.144467 Jan 15 15:59:31.192937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 541/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:31 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:31.624781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0ff7dbd4-b790-4613-9a38-dfedf8ff9f7e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:31.625842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0ff7dbd4-b790-4613-9a38-dfedf8ff9f7e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:31.632648 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff7dbd4-b790-4613-9a38-dfedf8ff9f7e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:31.633100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff7dbd4-b790-4613-9a38-dfedf8ff9f7e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:31.633917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff7dbd4-b790-4613-9a38-dfedf8ff9f7e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:31.634723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ff7dbd4-b790-4613-9a38-dfedf8ff9f7e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:31.696475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0ff7dbd4-b790-4613-9a38-dfedf8ff9f7e tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.075512 Jan 15 15:59:31.697241 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 537/1078] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:31 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:59:32.208651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:32.209288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:32.216096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:32.216577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:32.217364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:32.217807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:32.346770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:32.354018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bd0af46e-99c3-4fac-9aca-33d36d61bd58 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.149085 Jan 15 15:59:32.354579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 542/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:32 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:32.708822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-576b59cf-a9ab-4d52-a57d-1931a4db1344 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:32.709840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-576b59cf-a9ab-4d52-a57d-1931a4db1344 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:32.717921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-576b59cf-a9ab-4d52-a57d-1931a4db1344 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:32.718375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-576b59cf-a9ab-4d52-a57d-1931a4db1344 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:32.719183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-576b59cf-a9ab-4d52-a57d-1931a4db1344 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:32.719621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-576b59cf-a9ab-4d52-a57d-1931a4db1344 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:32.781305 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-576b59cf-a9ab-4d52-a57d-1931a4db1344 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.076448 Jan 15 15:59:32.785348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 538/1080] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:32 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:33.371240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:33.371795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:33.378107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:33.378574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:33.379351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:33.379799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:33.519261 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:33.527599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-db4ab50c-947a-4b66-a59b-4a650b7b073f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.160454 Jan 15 15:59:33.528467 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 543/1081] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:33 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:33.793748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2ca86e75-a811-4ce8-b7eb-3932f9ea9061 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:33.794789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2ca86e75-a811-4ce8-b7eb-3932f9ea9061 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:33.801692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ca86e75-a811-4ce8-b7eb-3932f9ea9061 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:33.802150 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ca86e75-a811-4ce8-b7eb-3932f9ea9061 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:33.802943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ca86e75-a811-4ce8-b7eb-3932f9ea9061 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:33.803390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ca86e75-a811-4ce8-b7eb-3932f9ea9061 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:33.863157 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2ca86e75-a811-4ce8-b7eb-3932f9ea9061 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.073421 Jan 15 15:59:33.866940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 539/1082] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:33 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:34.232048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-6e5841a9-7d45-4719-ab27-3f82cc0bfcad req-90a758f5-ee00-4ad0-a6ab-5a49417cff4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f56e96-7f77-4614-9eec-3853f80b7c12", "name": "network-vif-plugged", "status": "completed", "tag": "f9a8be92-5ef1-4477-bebd-e62518322788"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:34.233630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:59:34.233630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:59:34.240434 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6e5841a9-7d45-4719-ab27-3f82cc0bfcad req-90a758f5-ee00-4ad0-a6ab-5a49417cff4a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:34.240878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-6e5841a9-7d45-4719-ab27-3f82cc0bfcad req-90a758f5-ee00-4ad0-a6ab-5a49417cff4a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:34.251499 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-6e5841a9-7d45-4719-ab27-3f82cc0bfcad req-90a758f5-ee00-4ad0-a6ab-5a49417cff4a service nova] Creating event network-vif-plugged:f9a8be92-5ef1-4477-bebd-e62518322788 for instance 15f56e96-7f77-4614-9eec-3853f80b7c12 on hv-cinder-82481 Jan 15 15:59:34.256630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-6e5841a9-7d45-4719-ab27-3f82cc0bfcad req-90a758f5-ee00-4ad0-a6ab-5a49417cff4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028869 Jan 15 15:59:34.257209 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 544/1083] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:59:34.551710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:34.551710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:34.555209 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:34.557078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:34.557222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:34.557902 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:34.693990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:34.702058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ff270d43-2a99-4635-9f3e-e3aa24608743 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.159465 Jan 15 15:59:34.703020 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 540/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:34 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:34.876352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dcb798e8-ba3e-4fe7-aed5-2d27b7d72e16 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:34.877259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dcb798e8-ba3e-4fe7-aed5-2d27b7d72e16 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:34.883258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dcb798e8-ba3e-4fe7-aed5-2d27b7d72e16 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:34.883740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dcb798e8-ba3e-4fe7-aed5-2d27b7d72e16 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:34.884825 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dcb798e8-ba3e-4fe7-aed5-2d27b7d72e16 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:34.885275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dcb798e8-ba3e-4fe7-aed5-2d27b7d72e16 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:34.954975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dcb798e8-ba3e-4fe7-aed5-2d27b7d72e16 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.082974 Jan 15 15:59:34.955652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 545/1085] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:34 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:35.719354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:35.720053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:35.726418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:35.726867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:35.727646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:35.728157 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:35.859879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:35.867185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-250833a7-643d-4c1d-a331-17be5b97a6dd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1364 microversion: 2.1 time: 0.151553 Jan 15 15:59:35.867755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 541/1086] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:35 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:35.967237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d6e287d8-055e-4c1e-b397-cc3b4fdaa0f7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:35.968267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d6e287d8-055e-4c1e-b397-cc3b4fdaa0f7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:35.975047 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6e287d8-055e-4c1e-b397-cc3b4fdaa0f7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:35.975501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6e287d8-055e-4c1e-b397-cc3b4fdaa0f7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:35.976310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6e287d8-055e-4c1e-b397-cc3b4fdaa0f7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:35.976750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6e287d8-055e-4c1e-b397-cc3b4fdaa0f7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:36.047050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d6e287d8-055e-4c1e-b397-cc3b4fdaa0f7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.083796 Jan 15 15:59:36.048018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 546/1087] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:35 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:36.884632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:36.885477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:36.891494 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:36.894153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:36.894153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:36.894153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:37.021354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 15:59:37.029171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-df6c51f0-72ff-451d-98e2-6d2077b0e53f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1550 microversion: 2.1 time: 0.148707 Jan 15 15:59:37.029736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 542/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 15:59:36 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 15:59:37.046558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bf4a32a5-0062-438f-ab5d-b18ddca25a53 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 15:59:37.047136 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bf4a32a5-0062-438f-ab5d-b18ddca25a53 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:37.054066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bf4a32a5-0062-438f-ab5d-b18ddca25a53 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:37.054521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bf4a32a5-0062-438f-ab5d-b18ddca25a53 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:37.055298 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bf4a32a5-0062-438f-ab5d-b18ddca25a53 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:37.055762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bf4a32a5-0062-438f-ab5d-b18ddca25a53 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:37.058909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-dcc54c73-1396-47e5-a807-c288d9134074 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:37.059874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-dcc54c73-1396-47e5-a807-c288d9134074 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:37.065757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dcc54c73-1396-47e5-a807-c288d9134074 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:37.066207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dcc54c73-1396-47e5-a807-c288d9134074 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:37.066991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dcc54c73-1396-47e5-a807-c288d9134074 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:37.067447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dcc54c73-1396-47e5-a807-c288d9134074 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:37.125672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-dcc54c73-1396-47e5-a807-c288d9134074 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.070738 Jan 15 15:59:37.129552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 543/1089] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:37 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:59:37.136983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bf4a32a5-0062-438f-ab5d-b18ddca25a53 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093669 Jan 15 15:59:37.137780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 547/1090] 10.222.0.36 () {58 vars in 1274 bytes} [Sat Jan 15 15:59:37 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:59:38.133855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6da11e46-6880-44ad-9a55-97b49d5b9469 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:38.135563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6da11e46-6880-44ad-9a55-97b49d5b9469 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:38.138058 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-7132c4da-85f6-4cbb-bbd8-26d890bba29e req-d00caf6f-6945-4b47-b83b-e42203b775c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f56e96-7f77-4614-9eec-3853f80b7c12", "tag": "f9a8be92-5ef1-4477-bebd-e62518322788"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:38.139648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 15:59:38.139648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 15:59:38.143051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6da11e46-6880-44ad-9a55-97b49d5b9469 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:38.143474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6da11e46-6880-44ad-9a55-97b49d5b9469 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:38.144308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6da11e46-6880-44ad-9a55-97b49d5b9469 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:38.144738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6da11e46-6880-44ad-9a55-97b49d5b9469 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:38.146501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-7132c4da-85f6-4cbb-bbd8-26d890bba29e req-d00caf6f-6945-4b47-b83b-e42203b775c3 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:38.146951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-7132c4da-85f6-4cbb-bbd8-26d890bba29e req-d00caf6f-6945-4b47-b83b-e42203b775c3 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:38.158373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-7132c4da-85f6-4cbb-bbd8-26d890bba29e req-d00caf6f-6945-4b47-b83b-e42203b775c3 service nova] Creating event network-changed:f9a8be92-5ef1-4477-bebd-e62518322788 for instance 15f56e96-7f77-4614-9eec-3853f80b7c12 on hv-cinder-82481 Jan 15 15:59:38.163232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-7132c4da-85f6-4cbb-bbd8-26d890bba29e req-d00caf6f-6945-4b47-b83b-e42203b775c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029930 Jan 15 15:59:38.163842 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 548/1091] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 15:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 15:59:38.169164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-87c8837f-1fc3-432a-9089-e871486d829d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:38.170185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-87c8837f-1fc3-432a-9089-e871486d829d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:38.176863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87c8837f-1fc3-432a-9089-e871486d829d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:38.177314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87c8837f-1fc3-432a-9089-e871486d829d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:38.178121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87c8837f-1fc3-432a-9089-e871486d829d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:38.179201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87c8837f-1fc3-432a-9089-e871486d829d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:38.245362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-87c8837f-1fc3-432a-9089-e871486d829d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.079396 Jan 15 15:59:38.248595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 549/1092] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:38 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:38.367353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6da11e46-6880-44ad-9a55-97b49d5b9469 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.237742 Jan 15 15:59:38.371239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 544/1093] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:38 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:39.257321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a94cd915-2b65-4417-ae70-e41beee8faa9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:39.258018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a94cd915-2b65-4417-ae70-e41beee8faa9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:39.266083 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a94cd915-2b65-4417-ae70-e41beee8faa9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:39.269257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a94cd915-2b65-4417-ae70-e41beee8faa9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:39.269257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a94cd915-2b65-4417-ae70-e41beee8faa9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:39.269257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a94cd915-2b65-4417-ae70-e41beee8faa9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:39.328444 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a94cd915-2b65-4417-ae70-e41beee8faa9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.075738 Jan 15 15:59:39.329079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 550/1094] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:39 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:39.379197 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bd351188-2832-47d8-974c-e5bec72964e9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:39.380214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bd351188-2832-47d8-974c-e5bec72964e9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:39.387139 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd351188-2832-47d8-974c-e5bec72964e9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:39.387594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd351188-2832-47d8-974c-e5bec72964e9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:39.388409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd351188-2832-47d8-974c-e5bec72964e9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:39.388851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd351188-2832-47d8-974c-e5bec72964e9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:39.443338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bd351188-2832-47d8-974c-e5bec72964e9 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.068028 Jan 15 15:59:39.443936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 545/1095] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:39 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:40.341123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-aa74485d-e910-467b-b8d2-295ec4338bf7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:40.342051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-aa74485d-e910-467b-b8d2-295ec4338bf7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:40.348867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa74485d-e910-467b-b8d2-295ec4338bf7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:40.349317 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa74485d-e910-467b-b8d2-295ec4338bf7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:40.350098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa74485d-e910-467b-b8d2-295ec4338bf7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:40.350536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa74485d-e910-467b-b8d2-295ec4338bf7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:40.416941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-aa74485d-e910-467b-b8d2-295ec4338bf7 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.079908 Jan 15 15:59:40.417580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 551/1096] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:40 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:40.454357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-16df6f6d-ba66-4f5a-97cd-4f8041bdc0e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:40.455392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-16df6f6d-ba66-4f5a-97cd-4f8041bdc0e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:40.462735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16df6f6d-ba66-4f5a-97cd-4f8041bdc0e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:40.463191 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16df6f6d-ba66-4f5a-97cd-4f8041bdc0e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:40.463980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16df6f6d-ba66-4f5a-97cd-4f8041bdc0e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:40.464515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16df6f6d-ba66-4f5a-97cd-4f8041bdc0e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:40.519804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-16df6f6d-ba66-4f5a-97cd-4f8041bdc0e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.069289 Jan 15 15:59:40.520420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 546/1097] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:40 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:41.428243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4472bd39-78b0-48c3-9616-ee042b01df97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:41.429247 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4472bd39-78b0-48c3-9616-ee042b01df97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:41.437094 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4472bd39-78b0-48c3-9616-ee042b01df97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:41.437548 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4472bd39-78b0-48c3-9616-ee042b01df97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:41.438329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4472bd39-78b0-48c3-9616-ee042b01df97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:41.438768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4472bd39-78b0-48c3-9616-ee042b01df97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:41.500628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4472bd39-78b0-48c3-9616-ee042b01df97 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.076320 Jan 15 15:59:41.501262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 552/1098] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:41 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:41.531221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e74d4f3f-7339-4229-9ea5-c86a80c4cbb8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:41.532244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e74d4f3f-7339-4229-9ea5-c86a80c4cbb8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:41.539058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e74d4f3f-7339-4229-9ea5-c86a80c4cbb8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:41.539515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e74d4f3f-7339-4229-9ea5-c86a80c4cbb8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:41.540839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e74d4f3f-7339-4229-9ea5-c86a80c4cbb8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:41.541283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e74d4f3f-7339-4229-9ea5-c86a80c4cbb8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:41.604854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e74d4f3f-7339-4229-9ea5-c86a80c4cbb8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.077726 Jan 15 15:59:41.605476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 547/1099] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:41 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:42.513704 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6361cfa8-282f-47b4-a345-7d02717d6392 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:42.514728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6361cfa8-282f-47b4-a345-7d02717d6392 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:42.521483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6361cfa8-282f-47b4-a345-7d02717d6392 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:42.521927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6361cfa8-282f-47b4-a345-7d02717d6392 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:42.522700 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6361cfa8-282f-47b4-a345-7d02717d6392 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:42.523131 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6361cfa8-282f-47b4-a345-7d02717d6392 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:42.580697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6361cfa8-282f-47b4-a345-7d02717d6392 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.071774 Jan 15 15:59:42.581383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 553/1100] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:42 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:42.615124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7193bb02-00c6-412c-b66f-8f6f5ed3774e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:42.616133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7193bb02-00c6-412c-b66f-8f6f5ed3774e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:42.623451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7193bb02-00c6-412c-b66f-8f6f5ed3774e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:42.623907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7193bb02-00c6-412c-b66f-8f6f5ed3774e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:42.624723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7193bb02-00c6-412c-b66f-8f6f5ed3774e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:42.625166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7193bb02-00c6-412c-b66f-8f6f5ed3774e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:42.684424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7193bb02-00c6-412c-b66f-8f6f5ed3774e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.073134 Jan 15 15:59:42.685108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 548/1101] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:42 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:43.592052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a2735a33-364e-4f5d-b5a0-59d69330afa8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:43.593072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a2735a33-364e-4f5d-b5a0-59d69330afa8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:43.599870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2735a33-364e-4f5d-b5a0-59d69330afa8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:43.600371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2735a33-364e-4f5d-b5a0-59d69330afa8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:43.601152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2735a33-364e-4f5d-b5a0-59d69330afa8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:43.601589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2735a33-364e-4f5d-b5a0-59d69330afa8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:43.663817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a2735a33-364e-4f5d-b5a0-59d69330afa8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.075763 Jan 15 15:59:43.664594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 554/1102] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:43 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:43.694634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0d8b877e-f0d3-4022-ba49-3a3763afa450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:43.695616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0d8b877e-f0d3-4022-ba49-3a3763afa450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:43.702790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d8b877e-f0d3-4022-ba49-3a3763afa450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:43.703239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d8b877e-f0d3-4022-ba49-3a3763afa450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:43.704021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d8b877e-f0d3-4022-ba49-3a3763afa450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:43.704488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d8b877e-f0d3-4022-ba49-3a3763afa450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:43.761352 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0d8b877e-f0d3-4022-ba49-3a3763afa450 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.070574 Jan 15 15:59:43.762156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 549/1103] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:43 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:44.676729 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-34bdb153-6e04-40ec-8516-36aaa18c2348 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:44.677730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-34bdb153-6e04-40ec-8516-36aaa18c2348 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:44.685101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34bdb153-6e04-40ec-8516-36aaa18c2348 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:44.685557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34bdb153-6e04-40ec-8516-36aaa18c2348 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:44.686338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34bdb153-6e04-40ec-8516-36aaa18c2348 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:44.686783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34bdb153-6e04-40ec-8516-36aaa18c2348 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:44.745146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-34bdb153-6e04-40ec-8516-36aaa18c2348 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.072371 Jan 15 15:59:44.745770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 555/1104] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:44 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:44.772467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-040f3e48-4600-450c-8dc4-def4db67f7ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:44.773511 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-040f3e48-4600-450c-8dc4-def4db67f7ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:44.781211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-040f3e48-4600-450c-8dc4-def4db67f7ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:44.781663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-040f3e48-4600-450c-8dc4-def4db67f7ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:44.782448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-040f3e48-4600-450c-8dc4-def4db67f7ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:44.782885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-040f3e48-4600-450c-8dc4-def4db67f7ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:44.839988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-040f3e48-4600-450c-8dc4-def4db67f7ab tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.071518 Jan 15 15:59:44.840616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 550/1105] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:44 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:45.757161 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f6651705-0107-4296-9a95-d2dc3dd56739 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:45.758151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f6651705-0107-4296-9a95-d2dc3dd56739 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:45.765867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6651705-0107-4296-9a95-d2dc3dd56739 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:45.766310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6651705-0107-4296-9a95-d2dc3dd56739 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:45.767081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6651705-0107-4296-9a95-d2dc3dd56739 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:45.767523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6651705-0107-4296-9a95-d2dc3dd56739 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:45.830300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f6651705-0107-4296-9a95-d2dc3dd56739 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.077125 Jan 15 15:59:45.830904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 556/1106] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:45 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 15:59:45.851109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f0687f4f-3995-4bc0-b7bc-c3ef26d579b5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:45.852103 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f0687f4f-3995-4bc0-b7bc-c3ef26d579b5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:45.859450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0687f4f-3995-4bc0-b7bc-c3ef26d579b5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:45.859908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0687f4f-3995-4bc0-b7bc-c3ef26d579b5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:45.860722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0687f4f-3995-4bc0-b7bc-c3ef26d579b5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:45.861163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0687f4f-3995-4bc0-b7bc-c3ef26d579b5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:45.919420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f0687f4f-3995-4bc0-b7bc-c3ef26d579b5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.072247 Jan 15 15:59:45.920011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 551/1107] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:45 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 15:59:46.843761 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8df77023-8dd5-4ae4-80c3-d8241893ea56 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:46.844785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8df77023-8dd5-4ae4-80c3-d8241893ea56 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:46.851512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8df77023-8dd5-4ae4-80c3-d8241893ea56 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:46.851955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8df77023-8dd5-4ae4-80c3-d8241893ea56 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:46.852834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8df77023-8dd5-4ae4-80c3-d8241893ea56 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:46.853550 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8df77023-8dd5-4ae4-80c3-d8241893ea56 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:46.920775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8df77023-8dd5-4ae4-80c3-d8241893ea56 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.081162 Jan 15 15:59:46.921422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 557/1108] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:46 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:46.930579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-abcbcdcc-7c91-4058-ab97-857356e55835 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:46.931757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-abcbcdcc-7c91-4058-ab97-857356e55835 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:46.938927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abcbcdcc-7c91-4058-ab97-857356e55835 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:46.939392 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abcbcdcc-7c91-4058-ab97-857356e55835 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:46.940169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abcbcdcc-7c91-4058-ab97-857356e55835 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:46.940614 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-abcbcdcc-7c91-4058-ab97-857356e55835 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:47.005608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-abcbcdcc-7c91-4058-ab97-857356e55835 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.078999 Jan 15 15:59:47.006389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 552/1109] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:46 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 15:59:47.932881 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3437a29d-69e3-4e26-97af-2de1409d04b6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:47.933902 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3437a29d-69e3-4e26-97af-2de1409d04b6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:47.940721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3437a29d-69e3-4e26-97af-2de1409d04b6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:47.941171 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3437a29d-69e3-4e26-97af-2de1409d04b6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:47.941953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3437a29d-69e3-4e26-97af-2de1409d04b6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:47.942389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3437a29d-69e3-4e26-97af-2de1409d04b6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:48.011733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3437a29d-69e3-4e26-97af-2de1409d04b6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.082861 Jan 15 15:59:48.012638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 558/1110] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:47 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:48.016805 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b8cf2a76-83f3-4805-a3d8-9710ddb2cc12 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:48.017803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b8cf2a76-83f3-4805-a3d8-9710ddb2cc12 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:48.025130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cf2a76-83f3-4805-a3d8-9710ddb2cc12 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:48.025587 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cf2a76-83f3-4805-a3d8-9710ddb2cc12 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:48.026379 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cf2a76-83f3-4805-a3d8-9710ddb2cc12 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:48.026816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cf2a76-83f3-4805-a3d8-9710ddb2cc12 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:48.083524 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b8cf2a76-83f3-4805-a3d8-9710ddb2cc12 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 14 microversion: 2.1 time: 0.070665 Jan 15 15:59:48.084112 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 553/1111] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:48 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 15:59:49.023325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0b508d99-b4fe-4af1-b45b-d42a3170c6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:49.024448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0b508d99-b4fe-4af1-b45b-d42a3170c6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:49.032972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b508d99-b4fe-4af1-b45b-d42a3170c6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:49.033421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b508d99-b4fe-4af1-b45b-d42a3170c6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:49.034211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b508d99-b4fe-4af1-b45b-d42a3170c6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:49.034645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b508d99-b4fe-4af1-b45b-d42a3170c6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:49.094002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0b508d99-b4fe-4af1-b45b-d42a3170c6e6 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.074629 Jan 15 15:59:49.094823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 559/1112] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:49 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:49.094981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a6a78cd0-ea12-4c46-9e5d-e10de495cd36 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:49.095992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a6a78cd0-ea12-4c46-9e5d-e10de495cd36 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:49.102893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6a78cd0-ea12-4c46-9e5d-e10de495cd36 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:49.103448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6a78cd0-ea12-4c46-9e5d-e10de495cd36 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:49.104277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6a78cd0-ea12-4c46-9e5d-e10de495cd36 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:49.104724 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6a78cd0-ea12-4c46-9e5d-e10de495cd36 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:49.176268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a6a78cd0-ea12-4c46-9e5d-e10de495cd36 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 11861 microversion: 2.1 time: 0.085252 Jan 15 15:59:49.176899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 554/1113] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:49 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 11861 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:59:50.106360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3c4d5c73-6ab0-4e41-8436-e6be3721e919 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:50.107352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3c4d5c73-6ab0-4e41-8436-e6be3721e919 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:50.114205 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c4d5c73-6ab0-4e41-8436-e6be3721e919 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:50.114656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c4d5c73-6ab0-4e41-8436-e6be3721e919 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:50.115431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c4d5c73-6ab0-4e41-8436-e6be3721e919 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:50.115872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c4d5c73-6ab0-4e41-8436-e6be3721e919 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:50.182615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3c4d5c73-6ab0-4e41-8436-e6be3721e919 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.079311 Jan 15 15:59:50.183521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 560/1114] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:50 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:50.187549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5a24626f-e7b3-4113-886c-d72876925680 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:50.188577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5a24626f-e7b3-4113-886c-d72876925680 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:50.195374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a24626f-e7b3-4113-886c-d72876925680 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:50.195821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a24626f-e7b3-4113-886c-d72876925680 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:50.197052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a24626f-e7b3-4113-886c-d72876925680 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:50.197509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a24626f-e7b3-4113-886c-d72876925680 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:50.269079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5a24626f-e7b3-4113-886c-d72876925680 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 18561 microversion: 2.1 time: 0.085331 Jan 15 15:59:50.270401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 555/1115] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:50 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 18561 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 15:59:51.194756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1d665e8d-3b3f-452e-b3f3-03bb2537c143 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:51.195679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1d665e8d-3b3f-452e-b3f3-03bb2537c143 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:51.202608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1d665e8d-3b3f-452e-b3f3-03bb2537c143 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:51.203060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1d665e8d-3b3f-452e-b3f3-03bb2537c143 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:51.203838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1d665e8d-3b3f-452e-b3f3-03bb2537c143 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:51.204307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1d665e8d-3b3f-452e-b3f3-03bb2537c143 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:51.263265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1d665e8d-3b3f-452e-b3f3-03bb2537c143 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.072548 Jan 15 15:59:51.263887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 561/1116] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:51 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:51.281207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0f33a637-be3e-4ce6-a5d8-5920c651b10f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:51.282213 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0f33a637-be3e-4ce6-a5d8-5920c651b10f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:51.289060 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0f33a637-be3e-4ce6-a5d8-5920c651b10f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:51.289514 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0f33a637-be3e-4ce6-a5d8-5920c651b10f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:51.290302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0f33a637-be3e-4ce6-a5d8-5920c651b10f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:51.290743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0f33a637-be3e-4ce6-a5d8-5920c651b10f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:51.376616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0f33a637-be3e-4ce6-a5d8-5920c651b10f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 19133 microversion: 2.1 time: 0.099498 Jan 15 15:59:51.377263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 556/1117] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:51 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 19133 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:52.274654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2e69519d-70f6-40e0-a8a0-945cb7ea99d9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:52.275663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2e69519d-70f6-40e0-a8a0-945cb7ea99d9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:52.282779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e69519d-70f6-40e0-a8a0-945cb7ea99d9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:52.283233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e69519d-70f6-40e0-a8a0-945cb7ea99d9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:52.284025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e69519d-70f6-40e0-a8a0-945cb7ea99d9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:52.284492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2e69519d-70f6-40e0-a8a0-945cb7ea99d9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:52.345470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2e69519d-70f6-40e0-a8a0-945cb7ea99d9 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.074789 Jan 15 15:59:52.346028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 562/1118] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:52 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:52.387807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6c6b2d91-51ec-412a-9c4a-cecf1bb9b45b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:52.388879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6c6b2d91-51ec-412a-9c4a-cecf1bb9b45b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:52.395769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6c6b2d91-51ec-412a-9c4a-cecf1bb9b45b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:52.396257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6c6b2d91-51ec-412a-9c4a-cecf1bb9b45b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:52.397048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6c6b2d91-51ec-412a-9c4a-cecf1bb9b45b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:52.397487 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6c6b2d91-51ec-412a-9c4a-cecf1bb9b45b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:52.472736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6c6b2d91-51ec-412a-9c4a-cecf1bb9b45b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 21674 microversion: 2.1 time: 0.089318 Jan 15 15:59:52.473416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 557/1119] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:52 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 21674 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:53.357431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8e0b9f3c-aa85-4bfa-8257-2f144bf80858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:53.358392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8e0b9f3c-aa85-4bfa-8257-2f144bf80858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:53.365331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e0b9f3c-aa85-4bfa-8257-2f144bf80858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:53.365790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e0b9f3c-aa85-4bfa-8257-2f144bf80858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:53.366578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e0b9f3c-aa85-4bfa-8257-2f144bf80858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:53.367019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e0b9f3c-aa85-4bfa-8257-2f144bf80858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:53.427130 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8e0b9f3c-aa85-4bfa-8257-2f144bf80858 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.073803 Jan 15 15:59:53.428162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 563/1120] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:53 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:53.484636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6cc1f26e-123b-4d01-ae8a-0ad57edd4d21 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:53.485639 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6cc1f26e-123b-4d01-ae8a-0ad57edd4d21 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:53.492764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6cc1f26e-123b-4d01-ae8a-0ad57edd4d21 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:53.493220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6cc1f26e-123b-4d01-ae8a-0ad57edd4d21 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:53.494000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6cc1f26e-123b-4d01-ae8a-0ad57edd4d21 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:53.494464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6cc1f26e-123b-4d01-ae8a-0ad57edd4d21 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:53.570968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6cc1f26e-123b-4d01-ae8a-0ad57edd4d21 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 23235 microversion: 2.1 time: 0.090182 Jan 15 15:59:53.571781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 558/1121] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:53 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 23235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:54.439716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ab32f82f-ca59-4f82-9b24-8cbe50bfe962 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:54.440734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ab32f82f-ca59-4f82-9b24-8cbe50bfe962 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:54.447476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab32f82f-ca59-4f82-9b24-8cbe50bfe962 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:54.448578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab32f82f-ca59-4f82-9b24-8cbe50bfe962 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:54.449490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab32f82f-ca59-4f82-9b24-8cbe50bfe962 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:54.449924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab32f82f-ca59-4f82-9b24-8cbe50bfe962 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:54.510988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ab32f82f-ca59-4f82-9b24-8cbe50bfe962 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.074557 Jan 15 15:59:54.511627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 564/1122] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:54 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:54.583627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-04891de6-23ea-47ba-a98b-9ef825ddaed1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:54.584655 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-04891de6-23ea-47ba-a98b-9ef825ddaed1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:54.591935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-04891de6-23ea-47ba-a98b-9ef825ddaed1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:54.592407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-04891de6-23ea-47ba-a98b-9ef825ddaed1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:54.593197 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-04891de6-23ea-47ba-a98b-9ef825ddaed1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:54.593635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-04891de6-23ea-47ba-a98b-9ef825ddaed1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:54.664552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-04891de6-23ea-47ba-a98b-9ef825ddaed1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 24799 microversion: 2.1 time: 0.084671 Jan 15 15:59:54.665181 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 559/1123] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:54 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 24799 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:55.522811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-87ccf131-159f-4aee-a4d0-d584f4fa933a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:55.523876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-87ccf131-159f-4aee-a4d0-d584f4fa933a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:55.531421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87ccf131-159f-4aee-a4d0-d584f4fa933a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:55.531868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87ccf131-159f-4aee-a4d0-d584f4fa933a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:55.532677 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87ccf131-159f-4aee-a4d0-d584f4fa933a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:55.533119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-87ccf131-159f-4aee-a4d0-d584f4fa933a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:55.598761 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-87ccf131-159f-4aee-a4d0-d584f4fa933a tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.079812 Jan 15 15:59:55.599599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 565/1124] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:55 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:55.680788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d61f40d8-d381-4679-a70d-61bcf9b3b130 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:55.680788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d61f40d8-d381-4679-a70d-61bcf9b3b130 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:55.685065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d61f40d8-d381-4679-a70d-61bcf9b3b130 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:55.685501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d61f40d8-d381-4679-a70d-61bcf9b3b130 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:55.686286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d61f40d8-d381-4679-a70d-61bcf9b3b130 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:55.686788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d61f40d8-d381-4679-a70d-61bcf9b3b130 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:55.762646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d61f40d8-d381-4679-a70d-61bcf9b3b130 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 26318 microversion: 2.1 time: 0.090395 Jan 15 15:59:55.763207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 560/1125] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:55 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 26318 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:56.611477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fb447b9d-3015-4986-a4c8-bd991560488c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:56.612534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fb447b9d-3015-4986-a4c8-bd991560488c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:56.620060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fb447b9d-3015-4986-a4c8-bd991560488c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:56.620619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fb447b9d-3015-4986-a4c8-bd991560488c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:56.621322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fb447b9d-3015-4986-a4c8-bd991560488c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:56.621761 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fb447b9d-3015-4986-a4c8-bd991560488c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:56.692799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fb447b9d-3015-4986-a4c8-bd991560488c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.085223 Jan 15 15:59:56.693753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 566/1126] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:56 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:56.774457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-017fd79d-8bb6-4801-88a5-700348e81dae tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:56.775453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-017fd79d-8bb6-4801-88a5-700348e81dae tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:56.783266 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-017fd79d-8bb6-4801-88a5-700348e81dae tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:56.783715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-017fd79d-8bb6-4801-88a5-700348e81dae tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:56.784521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-017fd79d-8bb6-4801-88a5-700348e81dae tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:56.784957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-017fd79d-8bb6-4801-88a5-700348e81dae tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:56.861098 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-017fd79d-8bb6-4801-88a5-700348e81dae tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 27571 microversion: 2.1 time: 0.090324 Jan 15 15:59:56.861644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 561/1127] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:56 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 27571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:57.705871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b0a3e9dc-4570-48a1-a928-211b2cb6a401 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:57.707264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b0a3e9dc-4570-48a1-a928-211b2cb6a401 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:57.714675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0a3e9dc-4570-48a1-a928-211b2cb6a401 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:57.715124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0a3e9dc-4570-48a1-a928-211b2cb6a401 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:57.715999 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0a3e9dc-4570-48a1-a928-211b2cb6a401 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:57.716367 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0a3e9dc-4570-48a1-a928-211b2cb6a401 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:57.784061 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b0a3e9dc-4570-48a1-a928-211b2cb6a401 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.082147 Jan 15 15:59:57.784974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 567/1128] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:57 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:57.963733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f0f3bbca-1574-4399-8ae7-2312b2305f7d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:57.965463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f0f3bbca-1574-4399-8ae7-2312b2305f7d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:57.971429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0f3bbca-1574-4399-8ae7-2312b2305f7d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:57.971904 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0f3bbca-1574-4399-8ae7-2312b2305f7d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:57.972751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0f3bbca-1574-4399-8ae7-2312b2305f7d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:57.973199 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f0f3bbca-1574-4399-8ae7-2312b2305f7d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:58.050647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f0f3bbca-1574-4399-8ae7-2312b2305f7d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 27927 microversion: 2.1 time: 0.169977 Jan 15 15:59:58.051281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 562/1129] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:57 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 27927 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:58.796559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b50ae1b7-6803-4710-baaa-c7053f89a57b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:58.797725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b50ae1b7-6803-4710-baaa-c7053f89a57b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:58.804887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b7-6803-4710-baaa-c7053f89a57b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:58.805331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b7-6803-4710-baaa-c7053f89a57b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:58.806148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b7-6803-4710-baaa-c7053f89a57b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:58.806637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b50ae1b7-6803-4710-baaa-c7053f89a57b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:58.871417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b50ae1b7-6803-4710-baaa-c7053f89a57b tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 28676 microversion: 2.20 time: 0.080111 Jan 15 15:59:58.875233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 568/1130] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:58 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 28676 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 15:59:59.063225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-59649574-3578-4314-b900-6f9ca8ff87e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:59.064283 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-59649574-3578-4314-b900-6f9ca8ff87e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:59.071185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-59649574-3578-4314-b900-6f9ca8ff87e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:59.071641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-59649574-3578-4314-b900-6f9ca8ff87e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:59.073137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-59649574-3578-4314-b900-6f9ca8ff87e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:59.073588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-59649574-3578-4314-b900-6f9ca8ff87e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:59.150023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-59649574-3578-4314-b900-6f9ca8ff87e7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.090691 Jan 15 15:59:59.150710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 563/1131] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 15:59:59 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 15:59:59.883146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f597f743-8cc8-4b2d-bcb6-cd525f9d8442 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 15:59:59.884155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f597f743-8cc8-4b2d-bcb6-cd525f9d8442 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 15:59:59.891433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f597f743-8cc8-4b2d-bcb6-cd525f9d8442 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:59.891886 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f597f743-8cc8-4b2d-bcb6-cd525f9d8442 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:59.892690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f597f743-8cc8-4b2d-bcb6-cd525f9d8442 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 15:59:59.893155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f597f743-8cc8-4b2d-bcb6-cd525f9d8442 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 15:59:59.967811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f597f743-8cc8-4b2d-bcb6-cd525f9d8442 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 30731 microversion: 2.20 time: 0.088464 Jan 15 15:59:59.968430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 569/1132] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 15:59:59 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 30731 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:00.162259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f3376637-e751-434d-9658-6ebf3531b779 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:00.163263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f3376637-e751-434d-9658-6ebf3531b779 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:00.170183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3376637-e751-434d-9658-6ebf3531b779 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:00.170636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3376637-e751-434d-9658-6ebf3531b779 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:00.171418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3376637-e751-434d-9658-6ebf3531b779 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:00.171856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3376637-e751-434d-9658-6ebf3531b779 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:00.232092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f3376637-e751-434d-9658-6ebf3531b779 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.073713 Jan 15 16:00:00.232667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 564/1133] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:00 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:00.979347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-98a11783-e81a-41a6-abc1-7f35f054f531 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:00.981778 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-98a11783-e81a-41a6-abc1-7f35f054f531 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:00.988038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a11783-e81a-41a6-abc1-7f35f054f531 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:00.988525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a11783-e81a-41a6-abc1-7f35f054f531 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:00.989318 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a11783-e81a-41a6-abc1-7f35f054f531 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:00.989762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a11783-e81a-41a6-abc1-7f35f054f531 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:01.061334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-98a11783-e81a-41a6-abc1-7f35f054f531 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 32599 microversion: 2.20 time: 0.085912 Jan 15 16:00:01.061972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 570/1134] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:00 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 32599 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:01.244770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2fe5fcc7-63fe-40e7-ac53-df2c030a7a54 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:01.245865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2fe5fcc7-63fe-40e7-ac53-df2c030a7a54 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:01.252804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2fe5fcc7-63fe-40e7-ac53-df2c030a7a54 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:01.253264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2fe5fcc7-63fe-40e7-ac53-df2c030a7a54 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:01.254053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2fe5fcc7-63fe-40e7-ac53-df2c030a7a54 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:01.254496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2fe5fcc7-63fe-40e7-ac53-df2c030a7a54 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:01.316044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2fe5fcc7-63fe-40e7-ac53-df2c030a7a54 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.075454 Jan 15 16:00:01.317160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 565/1135] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:01 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:02.073413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-098b6cfb-5573-4ccc-8ba6-167aa314352c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:02.074410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-098b6cfb-5573-4ccc-8ba6-167aa314352c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:02.081247 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-098b6cfb-5573-4ccc-8ba6-167aa314352c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:02.081698 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-098b6cfb-5573-4ccc-8ba6-167aa314352c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:02.082479 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-098b6cfb-5573-4ccc-8ba6-167aa314352c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:02.082919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-098b6cfb-5573-4ccc-8ba6-167aa314352c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:02.156372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-098b6cfb-5573-4ccc-8ba6-167aa314352c tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 33617 microversion: 2.20 time: 0.086922 Jan 15 16:00:02.157000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 571/1136] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:02 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 33617 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:02.329072 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-37c1d87c-d2da-4fcb-868e-f735e62523e4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:02.330040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-37c1d87c-d2da-4fcb-868e-f735e62523e4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:02.336957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37c1d87c-d2da-4fcb-868e-f735e62523e4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:02.337415 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37c1d87c-d2da-4fcb-868e-f735e62523e4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:02.338832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37c1d87c-d2da-4fcb-868e-f735e62523e4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:02.339295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37c1d87c-d2da-4fcb-868e-f735e62523e4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:02.400216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-37c1d87c-d2da-4fcb-868e-f735e62523e4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.075119 Jan 15 16:00:02.401805 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 566/1137] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:02 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 16:00:03.168384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2c0487a3-c504-49f3-baee-65aa8e4f1622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:03.169384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2c0487a3-c504-49f3-baee-65aa8e4f1622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:03.176208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c0487a3-c504-49f3-baee-65aa8e4f1622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:03.176652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c0487a3-c504-49f3-baee-65aa8e4f1622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:03.177418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c0487a3-c504-49f3-baee-65aa8e4f1622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:03.177848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c0487a3-c504-49f3-baee-65aa8e4f1622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:03.262048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2c0487a3-c504-49f3-baee-65aa8e4f1622 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 34867 microversion: 2.20 time: 0.097606 Jan 15 16:00:03.262702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 572/1138] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:03 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 34867 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:03.413216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5eee1f02-e98c-48cd-bf24-2fc31911bcf6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:03.414219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5eee1f02-e98c-48cd-bf24-2fc31911bcf6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:03.421248 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5eee1f02-e98c-48cd-bf24-2fc31911bcf6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:03.421706 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5eee1f02-e98c-48cd-bf24-2fc31911bcf6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:03.422488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5eee1f02-e98c-48cd-bf24-2fc31911bcf6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:03.422927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5eee1f02-e98c-48cd-bf24-2fc31911bcf6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:03.491479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5eee1f02-e98c-48cd-bf24-2fc31911bcf6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.082247 Jan 15 16:00:03.492155 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 567/1139] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:03 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 16:00:04.274652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8b4b3729-b635-43b5-aa75-196ffa96a134 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:04.276675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8b4b3729-b635-43b5-aa75-196ffa96a134 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:04.283362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4b3729-b635-43b5-aa75-196ffa96a134 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:04.283808 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4b3729-b635-43b5-aa75-196ffa96a134 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:04.284614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4b3729-b635-43b5-aa75-196ffa96a134 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:04.285051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8b4b3729-b635-43b5-aa75-196ffa96a134 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:04.386411 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8b4b3729-b635-43b5-aa75-196ffa96a134 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 35991 microversion: 2.20 time: 0.115700 Jan 15 16:00:04.387103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 573/1140] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:04 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 35991 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:04.503369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-40d6d37b-2943-440a-a898-c3d534025418 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:04.504340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-40d6d37b-2943-440a-a898-c3d534025418 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:04.511228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40d6d37b-2943-440a-a898-c3d534025418 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:04.511677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40d6d37b-2943-440a-a898-c3d534025418 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:04.512484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40d6d37b-2943-440a-a898-c3d534025418 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:04.512927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40d6d37b-2943-440a-a898-c3d534025418 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:04.576712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-40d6d37b-2943-440a-a898-c3d534025418 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.077273 Jan 15 16:00:04.577372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 568/1141] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:04 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:05.398556 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ebe191c9-9d1b-4122-8bd9-822ca36d7c6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:05.399597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ebe191c9-9d1b-4122-8bd9-822ca36d7c6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:05.406824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe191c9-9d1b-4122-8bd9-822ca36d7c6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:05.407284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe191c9-9d1b-4122-8bd9-822ca36d7c6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:05.408075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe191c9-9d1b-4122-8bd9-822ca36d7c6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:05.408550 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ebe191c9-9d1b-4122-8bd9-822ca36d7c6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:05.482831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ebe191c9-9d1b-4122-8bd9-822ca36d7c6d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 37718 microversion: 2.20 time: 0.088149 Jan 15 16:00:05.483478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 574/1142] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:05 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 37718 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:05.598623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-49298dc3-c09e-4b94-bcde-65b52febbea6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:05.599613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-49298dc3-c09e-4b94-bcde-65b52febbea6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:05.607323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-49298dc3-c09e-4b94-bcde-65b52febbea6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:05.608452 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-49298dc3-c09e-4b94-bcde-65b52febbea6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:05.608583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-49298dc3-c09e-4b94-bcde-65b52febbea6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:05.609018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-49298dc3-c09e-4b94-bcde-65b52febbea6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:05.676064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-49298dc3-c09e-4b94-bcde-65b52febbea6 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.081198 Jan 15 16:00:05.676736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 569/1143] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:05 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:06.494997 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-adab1591-4fe4-4d20-9ce5-26ad75c146e1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:06.496007 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-adab1591-4fe4-4d20-9ce5-26ad75c146e1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:06.502861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adab1591-4fe4-4d20-9ce5-26ad75c146e1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:06.503313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adab1591-4fe4-4d20-9ce5-26ad75c146e1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:06.504096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adab1591-4fe4-4d20-9ce5-26ad75c146e1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:06.504564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-adab1591-4fe4-4d20-9ce5-26ad75c146e1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:06.575958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-adab1591-4fe4-4d20-9ce5-26ad75c146e1 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 38233 microversion: 2.20 time: 0.085529 Jan 15 16:00:06.576538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 575/1144] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:06 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 38233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:06.687856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5ef9fc32-b542-4543-bae0-7bb9f8d50059 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:06.688917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5ef9fc32-b542-4543-bae0-7bb9f8d50059 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:06.695669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ef9fc32-b542-4543-bae0-7bb9f8d50059 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:06.696117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ef9fc32-b542-4543-bae0-7bb9f8d50059 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:06.696913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ef9fc32-b542-4543-bae0-7bb9f8d50059 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:06.697930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5ef9fc32-b542-4543-bae0-7bb9f8d50059 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:06.764610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5ef9fc32-b542-4543-bae0-7bb9f8d50059 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.080538 Jan 15 16:00:06.765932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 570/1145] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:06 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:07.587477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7534347f-3a16-43a5-a66c-83a0c92efa19 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:07.588992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7534347f-3a16-43a5-a66c-83a0c92efa19 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:07.595833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7534347f-3a16-43a5-a66c-83a0c92efa19 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:07.596328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7534347f-3a16-43a5-a66c-83a0c92efa19 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:07.597117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7534347f-3a16-43a5-a66c-83a0c92efa19 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:07.597558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7534347f-3a16-43a5-a66c-83a0c92efa19 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:07.662492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7534347f-3a16-43a5-a66c-83a0c92efa19 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 38233 microversion: 2.20 time: 0.079050 Jan 15 16:00:07.663117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 576/1146] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:07 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 38233 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 16:00:07.777604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-215c92ab-d88f-46c0-b222-1b4e779b5457 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:07.778632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-215c92ab-d88f-46c0-b222-1b4e779b5457 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:07.785550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-215c92ab-d88f-46c0-b222-1b4e779b5457 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:07.786008 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-215c92ab-d88f-46c0-b222-1b4e779b5457 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:07.786794 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-215c92ab-d88f-46c0-b222-1b4e779b5457 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:07.787228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-215c92ab-d88f-46c0-b222-1b4e779b5457 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:07.846920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-215c92ab-d88f-46c0-b222-1b4e779b5457 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.074146 Jan 15 16:00:07.847457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 571/1147] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:07 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:08.674980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-510a6cf6-60e2-4351-9d84-40ccd23d6ce8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:08.676013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-510a6cf6-60e2-4351-9d84-40ccd23d6ce8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:08.683190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-510a6cf6-60e2-4351-9d84-40ccd23d6ce8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:08.683643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-510a6cf6-60e2-4351-9d84-40ccd23d6ce8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:08.684471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-510a6cf6-60e2-4351-9d84-40ccd23d6ce8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:08.684938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-510a6cf6-60e2-4351-9d84-40ccd23d6ce8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:08.749675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-510a6cf6-60e2-4351-9d84-40ccd23d6ce8 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 38233 microversion: 2.20 time: 0.078657 Jan 15 16:00:08.750319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 577/1148] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:08 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 38233 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:08.859488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0c49d238-9cc7-48be-9086-f91efe25575d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:08.860514 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0c49d238-9cc7-48be-9086-f91efe25575d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:08.867268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c49d238-9cc7-48be-9086-f91efe25575d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:08.867721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c49d238-9cc7-48be-9086-f91efe25575d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:08.868527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c49d238-9cc7-48be-9086-f91efe25575d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:08.869097 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c49d238-9cc7-48be-9086-f91efe25575d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:08.928619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0c49d238-9cc7-48be-9086-f91efe25575d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.072990 Jan 15 16:00:08.929491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 572/1149] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:08 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:09.762917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9649b251-56af-49eb-94d7-9a7f078a25c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:09.763864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9649b251-56af-49eb-94d7-9a7f078a25c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:09.770724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9649b251-56af-49eb-94d7-9a7f078a25c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:09.771177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9649b251-56af-49eb-94d7-9a7f078a25c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:09.771959 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9649b251-56af-49eb-94d7-9a7f078a25c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:09.772430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9649b251-56af-49eb-94d7-9a7f078a25c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:09.835291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9649b251-56af-49eb-94d7-9a7f078a25c0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 38233 microversion: 2.20 time: 0.077118 Jan 15 16:00:09.836193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 578/1150] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:09 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 38233 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 16:00:09.940823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7c1135c3-1cad-4e43-99d4-7eb36b096ff4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:09.941826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7c1135c3-1cad-4e43-99d4-7eb36b096ff4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:09.948937 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7c1135c3-1cad-4e43-99d4-7eb36b096ff4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:09.949389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7c1135c3-1cad-4e43-99d4-7eb36b096ff4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:09.950173 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7c1135c3-1cad-4e43-99d4-7eb36b096ff4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:09.950615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7c1135c3-1cad-4e43-99d4-7eb36b096ff4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:10.010756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7c1135c3-1cad-4e43-99d4-7eb36b096ff4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.074067 Jan 15 16:00:10.011605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 573/1151] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:09 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:10.847522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-300bcd61-fa00-45f3-b52b-b1cf160df3fc tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:10.848511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-300bcd61-fa00-45f3-b52b-b1cf160df3fc tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:10.855348 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-300bcd61-fa00-45f3-b52b-b1cf160df3fc tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:10.855799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-300bcd61-fa00-45f3-b52b-b1cf160df3fc tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:10.856616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-300bcd61-fa00-45f3-b52b-b1cf160df3fc tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:10.857060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-300bcd61-fa00-45f3-b52b-b1cf160df3fc tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:10.933009 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-300bcd61-fa00-45f3-b52b-b1cf160df3fc tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action" status: 200 len: 38376 microversion: 2.20 time: 0.089576 Jan 15 16:00:10.933894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 579/1152] 10.222.0.36 () {62 vars in 1318 bytes} [Sat Jan 15 16:00:10 2022] POST /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/action => generated 38376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:00:10.944350 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f70e1d1e-b0c5-426f-bf62-c36d82b5c30f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:00:10.944733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f70e1d1e-b0c5-426f-bf62-c36d82b5c30f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:10.952116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f70e1d1e-b0c5-426f-bf62-c36d82b5c30f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:10.952593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f70e1d1e-b0c5-426f-bf62-c36d82b5c30f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:10.953377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f70e1d1e-b0c5-426f-bf62-c36d82b5c30f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:10.953810 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f70e1d1e-b0c5-426f-bf62-c36d82b5c30f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:10.979086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f70e1d1e-b0c5-426f-bf62-c36d82b5c30f tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/ips" status: 200 len: 151 microversion: 2.20 time: 0.039104 Jan 15 16:00:10.979658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 574/1153] 10.222.0.36 () {60 vars in 1288 bytes} [Sat Jan 15 16:00:10 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:11.022827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d26eb234-9093-4df2-967e-828f88675016 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:11.023835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d26eb234-9093-4df2-967e-828f88675016 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:11.031333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d26eb234-9093-4df2-967e-828f88675016 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:11.031796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d26eb234-9093-4df2-967e-828f88675016 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:11.032620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d26eb234-9093-4df2-967e-828f88675016 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:11.033062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d26eb234-9093-4df2-967e-828f88675016 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:11.102212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d26eb234-9093-4df2-967e-828f88675016 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.083380 Jan 15 16:00:11.102823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 580/1154] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:11 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:12.116843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0e2c17f3-a16c-4bba-af99-bb88cb41a0fb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:12.117748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0e2c17f3-a16c-4bba-af99-bb88cb41a0fb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:12.124023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e2c17f3-a16c-4bba-af99-bb88cb41a0fb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:12.124503 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e2c17f3-a16c-4bba-af99-bb88cb41a0fb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:12.125275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e2c17f3-a16c-4bba-af99-bb88cb41a0fb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:12.125706 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e2c17f3-a16c-4bba-af99-bb88cb41a0fb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:12.192962 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0e2c17f3-a16c-4bba-af99-bb88cb41a0fb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28240 microversion: 2.1 time: 0.079641 Jan 15 16:00:12.193572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 575/1155] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:12 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:13.205709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b831661f-1c41-4ff5-b9db-ec6442f7c7fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:13.206634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b831661f-1c41-4ff5-b9db-ec6442f7c7fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:13.213914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b831661f-1c41-4ff5-b9db-ec6442f7c7fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:13.214363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b831661f-1c41-4ff5-b9db-ec6442f7c7fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:13.215145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b831661f-1c41-4ff5-b9db-ec6442f7c7fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:13.215580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b831661f-1c41-4ff5-b9db-ec6442f7c7fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:13.291833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b831661f-1c41-4ff5-b9db-ec6442f7c7fa tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28531 microversion: 2.1 time: 0.089220 Jan 15 16:00:13.292600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 581/1156] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:13 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28531 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:14.304005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-961c0a99-569f-4b6b-9207-c9fa8908c3a8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:14.304951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-961c0a99-569f-4b6b-9207-c9fa8908c3a8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:14.312011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-961c0a99-569f-4b6b-9207-c9fa8908c3a8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:14.312497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-961c0a99-569f-4b6b-9207-c9fa8908c3a8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:14.313286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-961c0a99-569f-4b6b-9207-c9fa8908c3a8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:14.313730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-961c0a99-569f-4b6b-9207-c9fa8908c3a8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:14.419226 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-961c0a99-569f-4b6b-9207-c9fa8908c3a8 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28656 microversion: 2.1 time: 0.119207 Jan 15 16:00:14.419883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 576/1157] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:14 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28656 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:15.431406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-11fdbacb-ebfe-468b-9310-04755001e447 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:15.432703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-11fdbacb-ebfe-468b-9310-04755001e447 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:15.439510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-11fdbacb-ebfe-468b-9310-04755001e447 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:15.439956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-11fdbacb-ebfe-468b-9310-04755001e447 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:15.440758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-11fdbacb-ebfe-468b-9310-04755001e447 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:15.441189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-11fdbacb-ebfe-468b-9310-04755001e447 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:15.518015 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-11fdbacb-ebfe-468b-9310-04755001e447 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.090581 Jan 15 16:00:15.518653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 582/1158] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:15 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:16.530639 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c92a57a5-d019-4d91-952d-236ba74d0cb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:16.531645 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c92a57a5-d019-4d91-952d-236ba74d0cb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:16.538536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c92a57a5-d019-4d91-952d-236ba74d0cb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:16.538987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c92a57a5-d019-4d91-952d-236ba74d0cb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:16.539768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c92a57a5-d019-4d91-952d-236ba74d0cb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:16.540231 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c92a57a5-d019-4d91-952d-236ba74d0cb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:16.601251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c92a57a5-d019-4d91-952d-236ba74d0cb7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.074823 Jan 15 16:00:16.602163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 577/1159] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:16 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:17.613913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-06533c1b-5612-402e-bea0-6363a3f121d0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:17.614920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-06533c1b-5612-402e-bea0-6363a3f121d0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:17.622181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06533c1b-5612-402e-bea0-6363a3f121d0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:17.622640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06533c1b-5612-402e-bea0-6363a3f121d0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:17.623430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06533c1b-5612-402e-bea0-6363a3f121d0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:17.623874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06533c1b-5612-402e-bea0-6363a3f121d0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:17.691104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-06533c1b-5612-402e-bea0-6363a3f121d0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.081156 Jan 15 16:00:17.691733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 583/1160] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:17 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:18.702913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-67f7823c-1db7-49fc-8141-e3f162bc1546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:18.703927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-67f7823c-1db7-49fc-8141-e3f162bc1546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:18.710784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67f7823c-1db7-49fc-8141-e3f162bc1546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:18.711242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67f7823c-1db7-49fc-8141-e3f162bc1546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:18.712030 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67f7823c-1db7-49fc-8141-e3f162bc1546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:18.713043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67f7823c-1db7-49fc-8141-e3f162bc1546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:18.782701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-67f7823c-1db7-49fc-8141-e3f162bc1546 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.083681 Jan 15 16:00:18.786584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 578/1161] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:18 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:19.795122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a8d9b321-e32f-49a8-b08f-b287dcf3f552 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:19.796177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a8d9b321-e32f-49a8-b08f-b287dcf3f552 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:19.802993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d9b321-e32f-49a8-b08f-b287dcf3f552 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:19.803441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d9b321-e32f-49a8-b08f-b287dcf3f552 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:19.804251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d9b321-e32f-49a8-b08f-b287dcf3f552 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:19.804691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d9b321-e32f-49a8-b08f-b287dcf3f552 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:19.868025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a8d9b321-e32f-49a8-b08f-b287dcf3f552 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.077048 Jan 15 16:00:19.869363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 584/1162] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:19 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:20.880781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-70bce1d4-85ad-4c74-84b1-de7346204d5e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:20.881795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-70bce1d4-85ad-4c74-84b1-de7346204d5e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:20.889629 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70bce1d4-85ad-4c74-84b1-de7346204d5e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:20.890108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70bce1d4-85ad-4c74-84b1-de7346204d5e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:20.890893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70bce1d4-85ad-4c74-84b1-de7346204d5e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:20.891339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70bce1d4-85ad-4c74-84b1-de7346204d5e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:20.955459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-70bce1d4-85ad-4c74-84b1-de7346204d5e tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.078500 Jan 15 16:00:20.959174 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 579/1163] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:20 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:21.967938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ac7c7220-0258-4a58-b18c-8429fbdf5a93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:21.970213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ac7c7220-0258-4a58-b18c-8429fbdf5a93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:21.977450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac7c7220-0258-4a58-b18c-8429fbdf5a93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:21.977913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac7c7220-0258-4a58-b18c-8429fbdf5a93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:21.978866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac7c7220-0258-4a58-b18c-8429fbdf5a93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:21.979316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac7c7220-0258-4a58-b18c-8429fbdf5a93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:22.043007 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ac7c7220-0258-4a58-b18c-8429fbdf5a93 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.078822 Jan 15 16:00:22.044034 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 585/1164] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:21 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:23.055031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cc53ba69-ff04-4a86-9064-c8e5175e7be4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:23.056114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cc53ba69-ff04-4a86-9064-c8e5175e7be4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:23.063255 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc53ba69-ff04-4a86-9064-c8e5175e7be4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:23.063709 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc53ba69-ff04-4a86-9064-c8e5175e7be4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:23.064536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc53ba69-ff04-4a86-9064-c8e5175e7be4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:23.064970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc53ba69-ff04-4a86-9064-c8e5175e7be4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:23.147733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cc53ba69-ff04-4a86-9064-c8e5175e7be4 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.096548 Jan 15 16:00:23.148410 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 580/1165] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:23 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:24.159192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6db0ffcb-fce8-44b5-9fcf-89248a3a9e64 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:24.160295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6db0ffcb-fce8-44b5-9fcf-89248a3a9e64 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:24.167272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6db0ffcb-fce8-44b5-9fcf-89248a3a9e64 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:24.167755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6db0ffcb-fce8-44b5-9fcf-89248a3a9e64 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:24.168562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6db0ffcb-fce8-44b5-9fcf-89248a3a9e64 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:24.168994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6db0ffcb-fce8-44b5-9fcf-89248a3a9e64 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:24.234516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6db0ffcb-fce8-44b5-9fcf-89248a3a9e64 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.079240 Jan 15 16:00:24.235147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 586/1166] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:24 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:25.247552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-51dd98ed-a0a5-4e11-8528-1980c1687ece tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:25.248596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-51dd98ed-a0a5-4e11-8528-1980c1687ece tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:25.255468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-51dd98ed-a0a5-4e11-8528-1980c1687ece tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:25.255922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-51dd98ed-a0a5-4e11-8528-1980c1687ece tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:25.256747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-51dd98ed-a0a5-4e11-8528-1980c1687ece tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:25.257194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-51dd98ed-a0a5-4e11-8528-1980c1687ece tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:25.342921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-51dd98ed-a0a5-4e11-8528-1980c1687ece tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.099990 Jan 15 16:00:25.343730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 581/1167] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:25 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:26.355776 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-75d421de-10db-44ca-ae3f-8423f86039f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:26.356812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-75d421de-10db-44ca-ae3f-8423f86039f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:26.364274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d421de-10db-44ca-ae3f-8423f86039f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:26.364732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d421de-10db-44ca-ae3f-8423f86039f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:26.365528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d421de-10db-44ca-ae3f-8423f86039f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:26.365971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75d421de-10db-44ca-ae3f-8423f86039f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:26.433432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-75d421de-10db-44ca-ae3f-8423f86039f0 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.074578 Jan 15 16:00:26.433432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 587/1168] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:26 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:27.438832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-13bdc4c2-ec66-4a4f-a657-bd301a2f6445 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:27.439844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-13bdc4c2-ec66-4a4f-a657-bd301a2f6445 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:27.447468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-13bdc4c2-ec66-4a4f-a657-bd301a2f6445 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:27.448200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-13bdc4c2-ec66-4a4f-a657-bd301a2f6445 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:27.448748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-13bdc4c2-ec66-4a4f-a657-bd301a2f6445 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:27.449214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-13bdc4c2-ec66-4a4f-a657-bd301a2f6445 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:27.513970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-13bdc4c2-ec66-4a4f-a657-bd301a2f6445 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.079178 Jan 15 16:00:27.514826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 582/1169] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:27 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:28.526933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6dd9260e-d54e-4cc2-851b-d1391df37c97 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:28.527975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6dd9260e-d54e-4cc2-851b-d1391df37c97 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:28.534666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd9260e-d54e-4cc2-851b-d1391df37c97 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:28.535125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd9260e-d54e-4cc2-851b-d1391df37c97 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:28.535923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd9260e-d54e-4cc2-851b-d1391df37c97 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:28.536393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6dd9260e-d54e-4cc2-851b-d1391df37c97 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:28.598612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6dd9260e-d54e-4cc2-851b-d1391df37c97 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.076302 Jan 15 16:00:28.599257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 588/1170] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:28 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:29.610428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d61d7c2-0c05-4e58-a55a-31e416054bfb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:29.611530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d61d7c2-0c05-4e58-a55a-31e416054bfb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:29.619071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d61d7c2-0c05-4e58-a55a-31e416054bfb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:29.619532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d61d7c2-0c05-4e58-a55a-31e416054bfb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:29.620359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d61d7c2-0c05-4e58-a55a-31e416054bfb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:29.620800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d61d7c2-0c05-4e58-a55a-31e416054bfb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:29.680480 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d61d7c2-0c05-4e58-a55a-31e416054bfb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.073946 Jan 15 16:00:29.681288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 583/1171] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:29 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:30.692352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b9e34eb0-93f9-4db0-8a0f-57528f0bb046 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:30.693355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b9e34eb0-93f9-4db0-8a0f-57528f0bb046 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:30.700979 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9e34eb0-93f9-4db0-8a0f-57528f0bb046 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:30.701427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9e34eb0-93f9-4db0-8a0f-57528f0bb046 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:30.702215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9e34eb0-93f9-4db0-8a0f-57528f0bb046 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:30.702655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9e34eb0-93f9-4db0-8a0f-57528f0bb046 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:30.765880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b9e34eb0-93f9-4db0-8a0f-57528f0bb046 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.077492 Jan 15 16:00:30.766536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 589/1172] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:30 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:31.778437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a7c85d8e-a2dd-4ef3-8a1c-3cb3dd9d60b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:31.779432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a7c85d8e-a2dd-4ef3-8a1c-3cb3dd9d60b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:31.786253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7c85d8e-a2dd-4ef3-8a1c-3cb3dd9d60b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:31.786703 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7c85d8e-a2dd-4ef3-8a1c-3cb3dd9d60b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:31.787477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7c85d8e-a2dd-4ef3-8a1c-3cb3dd9d60b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:31.787912 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7c85d8e-a2dd-4ef3-8a1c-3cb3dd9d60b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:31.876341 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a7c85d8e-a2dd-4ef3-8a1c-3cb3dd9d60b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.102365 Jan 15 16:00:31.877685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 584/1173] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:31 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:32.888629 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6a6fd0bc-db63-4cee-b898-cab782b7930b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:32.889634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6a6fd0bc-db63-4cee-b898-cab782b7930b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:32.896509 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6fd0bc-db63-4cee-b898-cab782b7930b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:32.896982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6fd0bc-db63-4cee-b898-cab782b7930b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:32.897779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6fd0bc-db63-4cee-b898-cab782b7930b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:32.898206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a6fd0bc-db63-4cee-b898-cab782b7930b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:32.960185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6a6fd0bc-db63-4cee-b898-cab782b7930b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.076190 Jan 15 16:00:32.960837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 590/1174] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:32 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:33.972505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-84c16978-294a-4e49-8c8d-2416bbf07439 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:33.973500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-84c16978-294a-4e49-8c8d-2416bbf07439 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:33.980712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84c16978-294a-4e49-8c8d-2416bbf07439 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:33.981161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84c16978-294a-4e49-8c8d-2416bbf07439 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:33.981934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84c16978-294a-4e49-8c8d-2416bbf07439 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:33.982467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84c16978-294a-4e49-8c8d-2416bbf07439 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:34.045554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-84c16978-294a-4e49-8c8d-2416bbf07439 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.076973 Jan 15 16:00:34.046268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 585/1175] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:33 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:35.058110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-30867587-8ffc-4491-91da-841326647cc3 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:35.059112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-30867587-8ffc-4491-91da-841326647cc3 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:35.065983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30867587-8ffc-4491-91da-841326647cc3 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:35.066432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30867587-8ffc-4491-91da-841326647cc3 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:35.067213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30867587-8ffc-4491-91da-841326647cc3 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:35.067675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30867587-8ffc-4491-91da-841326647cc3 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:35.128850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-30867587-8ffc-4491-91da-841326647cc3 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.075134 Jan 15 16:00:35.129732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 591/1176] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:35 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:36.141202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4aedadab-6f5f-4e4b-9f98-48a3f5d348cd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:36.142208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4aedadab-6f5f-4e4b-9f98-48a3f5d348cd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:36.149877 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4aedadab-6f5f-4e4b-9f98-48a3f5d348cd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:36.150968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4aedadab-6f5f-4e4b-9f98-48a3f5d348cd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:36.151772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4aedadab-6f5f-4e4b-9f98-48a3f5d348cd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:36.152329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4aedadab-6f5f-4e4b-9f98-48a3f5d348cd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:36.213187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4aedadab-6f5f-4e4b-9f98-48a3f5d348cd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.074951 Jan 15 16:00:36.214260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 586/1177] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:36 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:37.226153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d64833c7-411d-41a0-99a8-7e2dc95227d7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:37.227090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d64833c7-411d-41a0-99a8-7e2dc95227d7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:37.234735 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d64833c7-411d-41a0-99a8-7e2dc95227d7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:37.235189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d64833c7-411d-41a0-99a8-7e2dc95227d7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:37.236100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d64833c7-411d-41a0-99a8-7e2dc95227d7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:37.236568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d64833c7-411d-41a0-99a8-7e2dc95227d7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:37.295498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d64833c7-411d-41a0-99a8-7e2dc95227d7 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.073315 Jan 15 16:00:37.296246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 592/1178] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:37 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:38.307776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-18c6c42c-46da-4348-b630-35152a2a2434 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:38.308729 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-18c6c42c-46da-4348-b630-35152a2a2434 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:38.315548 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18c6c42c-46da-4348-b630-35152a2a2434 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:38.315996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18c6c42c-46da-4348-b630-35152a2a2434 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:38.316804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18c6c42c-46da-4348-b630-35152a2a2434 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:38.317242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18c6c42c-46da-4348-b630-35152a2a2434 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:38.377448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-18c6c42c-46da-4348-b630-35152a2a2434 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.074613 Jan 15 16:00:38.378066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 587/1179] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:38 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:39.390233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ae70fcb0-8876-4545-88e7-38ff719daa40 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:39.391246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ae70fcb0-8876-4545-88e7-38ff719daa40 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:39.398165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae70fcb0-8876-4545-88e7-38ff719daa40 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:39.398619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae70fcb0-8876-4545-88e7-38ff719daa40 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:39.400096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae70fcb0-8876-4545-88e7-38ff719daa40 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:39.400837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ae70fcb0-8876-4545-88e7-38ff719daa40 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:39.460557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ae70fcb0-8876-4545-88e7-38ff719daa40 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.074269 Jan 15 16:00:39.461442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 593/1180] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:39 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:40.472747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f7deefc7-07d6-4899-9f68-47cac3a44885 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:40.473754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f7deefc7-07d6-4899-9f68-47cac3a44885 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:40.480768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7deefc7-07d6-4899-9f68-47cac3a44885 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:40.481227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7deefc7-07d6-4899-9f68-47cac3a44885 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:40.482023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7deefc7-07d6-4899-9f68-47cac3a44885 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:40.482469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7deefc7-07d6-4899-9f68-47cac3a44885 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:40.542385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f7deefc7-07d6-4899-9f68-47cac3a44885 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.073649 Jan 15 16:00:40.543006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 588/1181] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:40 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:41.554441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f2c6ad17-48d8-4dcd-bd5b-9b68e125f5b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:41.555603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f2c6ad17-48d8-4dcd-bd5b-9b68e125f5b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:41.562546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad17-48d8-4dcd-bd5b-9b68e125f5b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:41.562990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad17-48d8-4dcd-bd5b-9b68e125f5b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:41.563758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad17-48d8-4dcd-bd5b-9b68e125f5b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:41.564245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad17-48d8-4dcd-bd5b-9b68e125f5b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:41.623542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f2c6ad17-48d8-4dcd-bd5b-9b68e125f5b1 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.072999 Jan 15 16:00:41.624186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 594/1182] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:41 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:42.636440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fe658a84-f682-4260-a773-6dc744cba516 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:42.637441 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fe658a84-f682-4260-a773-6dc744cba516 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:42.644370 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe658a84-f682-4260-a773-6dc744cba516 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:42.644826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe658a84-f682-4260-a773-6dc744cba516 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:42.645613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe658a84-f682-4260-a773-6dc744cba516 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:42.646052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fe658a84-f682-4260-a773-6dc744cba516 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:42.711432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fe658a84-f682-4260-a773-6dc744cba516 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 28699 microversion: 2.1 time: 0.079742 Jan 15 16:00:42.712385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 589/1183] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:42 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 28699 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:43.723305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-400abfdf-9fc4-4ee7-a0f5-e47c68b87b2a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:43.724336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-400abfdf-9fc4-4ee7-a0f5-e47c68b87b2a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:43.731734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-400abfdf-9fc4-4ee7-a0f5-e47c68b87b2a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:43.732215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-400abfdf-9fc4-4ee7-a0f5-e47c68b87b2a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:43.732992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-400abfdf-9fc4-4ee7-a0f5-e47c68b87b2a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:43.733431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-400abfdf-9fc4-4ee7-a0f5-e47c68b87b2a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:43.809410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-400abfdf-9fc4-4ee7-a0f5-e47c68b87b2a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 29266 microversion: 2.1 time: 0.090050 Jan 15 16:00:43.810035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 595/1184] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:43 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 29266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:44.821570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-026c1838-b028-4f6c-af03-4941604f016c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:44.822588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-026c1838-b028-4f6c-af03-4941604f016c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:44.829546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-026c1838-b028-4f6c-af03-4941604f016c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:44.830006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-026c1838-b028-4f6c-af03-4941604f016c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:44.830799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-026c1838-b028-4f6c-af03-4941604f016c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:44.831240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-026c1838-b028-4f6c-af03-4941604f016c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:44.907312 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-026c1838-b028-4f6c-af03-4941604f016c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 31411 microversion: 2.1 time: 0.090274 Jan 15 16:00:44.907924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 590/1185] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:44 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 31411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:45.919459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-60876f55-68c4-45de-8d05-6b22da5105fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:45.920503 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-60876f55-68c4-45de-8d05-6b22da5105fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:45.927364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60876f55-68c4-45de-8d05-6b22da5105fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:45.927823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60876f55-68c4-45de-8d05-6b22da5105fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:45.928638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60876f55-68c4-45de-8d05-6b22da5105fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:45.929081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60876f55-68c4-45de-8d05-6b22da5105fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:46.001552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-60876f55-68c4-45de-8d05-6b22da5105fd tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 32754 microversion: 2.1 time: 0.086033 Jan 15 16:00:46.002192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 596/1186] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:45 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 32754 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:47.013754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d210daed-2187-4162-8965-56499bef2be2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:47.014898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d210daed-2187-4162-8965-56499bef2be2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:47.021764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d210daed-2187-4162-8965-56499bef2be2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:47.022215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d210daed-2187-4162-8965-56499bef2be2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:47.022992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d210daed-2187-4162-8965-56499bef2be2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:47.023428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d210daed-2187-4162-8965-56499bef2be2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:47.097500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d210daed-2187-4162-8965-56499bef2be2 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 33783 microversion: 2.1 time: 0.087638 Jan 15 16:00:47.098522 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 591/1187] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:47 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 33783 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:48.109552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ed482fd-7a76-4016-bef7-c70dc41d1dcc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:48.110574 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ed482fd-7a76-4016-bef7-c70dc41d1dcc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:48.117361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ed482fd-7a76-4016-bef7-c70dc41d1dcc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:48.117808 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ed482fd-7a76-4016-bef7-c70dc41d1dcc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:48.118583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ed482fd-7a76-4016-bef7-c70dc41d1dcc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:48.119011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ed482fd-7a76-4016-bef7-c70dc41d1dcc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:48.199064 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ed482fd-7a76-4016-bef7-c70dc41d1dcc tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 35214 microversion: 2.1 time: 0.093403 Jan 15 16:00:48.203546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 597/1188] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:48 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 35214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:49.212336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-67df7590-37e0-47f1-8ced-f26992cb9b4a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:49.213254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-67df7590-37e0-47f1-8ced-f26992cb9b4a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:49.220160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67df7590-37e0-47f1-8ced-f26992cb9b4a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:49.220629 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67df7590-37e0-47f1-8ced-f26992cb9b4a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:49.221418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67df7590-37e0-47f1-8ced-f26992cb9b4a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:49.221866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67df7590-37e0-47f1-8ced-f26992cb9b4a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:49.294645 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-67df7590-37e0-47f1-8ced-f26992cb9b4a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 36743 microversion: 2.1 time: 0.086840 Jan 15 16:00:49.295474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 592/1189] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:49 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 36743 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:50.306925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8f76f3b2-e6a7-4a1a-867a-9c04bfd21c0b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:50.307938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8f76f3b2-e6a7-4a1a-867a-9c04bfd21c0b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:50.315244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f76f3b2-e6a7-4a1a-867a-9c04bfd21c0b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:50.315693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f76f3b2-e6a7-4a1a-867a-9c04bfd21c0b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:50.316530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f76f3b2-e6a7-4a1a-867a-9c04bfd21c0b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:50.316974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8f76f3b2-e6a7-4a1a-867a-9c04bfd21c0b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:50.388091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8f76f3b2-e6a7-4a1a-867a-9c04bfd21c0b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 38234 microversion: 2.1 time: 0.085878 Jan 15 16:00:50.388765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 598/1190] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:50 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 38234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:51.399757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4655f60d-8ca9-4ff2-ac68-0d18c8205086 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:51.400975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4655f60d-8ca9-4ff2-ac68-0d18c8205086 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:51.407762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4655f60d-8ca9-4ff2-ac68-0d18c8205086 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:51.408244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4655f60d-8ca9-4ff2-ac68-0d18c8205086 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:51.409032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4655f60d-8ca9-4ff2-ac68-0d18c8205086 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:51.409477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4655f60d-8ca9-4ff2-ac68-0d18c8205086 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:51.472692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4655f60d-8ca9-4ff2-ac68-0d18c8205086 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 38234 microversion: 2.1 time: 0.077390 Jan 15 16:00:51.473543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 593/1191] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:51 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 38234 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:52.484876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f9b49c20-d7e0-41f9-be2b-cba8f5e76c1d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:52.485876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f9b49c20-d7e0-41f9-be2b-cba8f5e76c1d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:52.493198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b49c20-d7e0-41f9-be2b-cba8f5e76c1d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:52.493743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b49c20-d7e0-41f9-be2b-cba8f5e76c1d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:52.494526 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b49c20-d7e0-41f9-be2b-cba8f5e76c1d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:52.494967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9b49c20-d7e0-41f9-be2b-cba8f5e76c1d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:52.563035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f9b49c20-d7e0-41f9-be2b-cba8f5e76c1d tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 38234 microversion: 2.1 time: 0.081971 Jan 15 16:00:52.563886 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 599/1192] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:52 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 38234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:53.575994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-db0a33a2-afe4-4dc0-bca7-4f7bd7bc1a83 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:53.577030 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-db0a33a2-afe4-4dc0-bca7-4f7bd7bc1a83 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:53.583951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db0a33a2-afe4-4dc0-bca7-4f7bd7bc1a83 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:53.584446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db0a33a2-afe4-4dc0-bca7-4f7bd7bc1a83 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:53.585234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db0a33a2-afe4-4dc0-bca7-4f7bd7bc1a83 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:53.585677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db0a33a2-afe4-4dc0-bca7-4f7bd7bc1a83 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:53.648497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-db0a33a2-afe4-4dc0-bca7-4f7bd7bc1a83 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 38234 microversion: 2.1 time: 0.076357 Jan 15 16:00:53.650518 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 594/1193] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:53 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 38234 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:54.661966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ac5f400-3e8f-4456-9e39-3ec89cda256c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:00:54.662965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ac5f400-3e8f-4456-9e39-3ec89cda256c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:54.670564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ac5f400-3e8f-4456-9e39-3ec89cda256c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:54.671275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ac5f400-3e8f-4456-9e39-3ec89cda256c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:54.672084 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ac5f400-3e8f-4456-9e39-3ec89cda256c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:54.672557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ac5f400-3e8f-4456-9e39-3ec89cda256c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:54.750722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ac5f400-3e8f-4456-9e39-3ec89cda256c tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action" status: 200 len: 38365 microversion: 2.1 time: 0.092585 Jan 15 16:00:54.751597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 600/1194] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:00:54 2022] POST /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/action => generated 38365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 16:00:54.762574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0e5e8634-23e6-48ed-b224-fe207a2b825a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:00:54.763238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0e5e8634-23e6-48ed-b224-fe207a2b825a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:00:54.770167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e5e8634-23e6-48ed-b224-fe207a2b825a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:54.770686 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e5e8634-23e6-48ed-b224-fe207a2b825a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:54.777131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e5e8634-23e6-48ed-b224-fe207a2b825a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:00:54.777131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0e5e8634-23e6-48ed-b224-fe207a2b825a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:00:54.796001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0e5e8634-23e6-48ed-b224-fe207a2b825a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/ips" status: 200 len: 145 microversion: 2.1 time: 0.038113 Jan 15 16:00:54.796604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 595/1195] 10.222.0.36 () {58 vars in 1247 bytes} [Sat Jan 15 16:00:54 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:03:17.668298 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:03:17.669682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:03:24.299651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:03:24.300270 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:03:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:03:24.320870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:03:24.321344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:03:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:03:31.983179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:03:31.983811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:03:33.832710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:03:33.833414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:03:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:03:48.214967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:03:48.215464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:04:01.915596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [-] [14db0917-d513-4ff7-a257-d7f8104704fb] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 16:04:01.920307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:01.920995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:01.927135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:01.927583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:01.928392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:01.928829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:01.953547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:04:02.219696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-32aaf647-f006-49cb-9a32-40dcaf82fb64 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 204 len: 0 microversion: 2.1 time: 0.305978 Jan 15 16:04:02.220335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 601/1196] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:04:01 2022] DELETE /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:04:02.226671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 16:04:02.230218 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:02.230832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:02.236901 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:02.239563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:02.239563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:02.239563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:02.445196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:02.453717 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-74da6786-f3fd-4541-98d7-e7438cb06653 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.229153 Jan 15 16:04:02.454284 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 596/1197] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:02 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:03.472253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:03.472876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:03.481051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:03.481317 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:03.482098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:03.482531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:03.489328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] [14db0917-d513-4ff7-a257-d7f8104704fb] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59498. Jan 15 16:04:03.665464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:03.674002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2c8b39af-e79a-491a-8b57-f0e99af6077f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.205969 Jan 15 16:04:03.674582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 602/1198] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:03 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:04.691786 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:04.692812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:04.699795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:04.702935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:04.702935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:04.702935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:04.726851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59518. Jan 15 16:04:04.839678 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:04.847994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4b2788f7-9ba6-4e5e-96ac-69cf1bfdc944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.159841 Jan 15 16:04:04.848610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 597/1199] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:04 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:05.873957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:05.874536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:05.884397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:05.884952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:05.885825 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:05.886339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:06.027313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:06.049050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e956a3b1-4273-4b07-acf0-0d064dc3ef01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.175597 Jan 15 16:04:06.049050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 603/1200] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:05 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:07.054915 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:07.055540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:07.062491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:07.062941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:07.063729 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:07.064198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:07.206535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:07.214402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-056e3ee6-2a43-4bfe-93c3-04aa537970b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.163453 Jan 15 16:04:07.215045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 598/1201] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:07 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:04:08.231241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:08.231863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:08.238812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:08.239265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:08.240057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:08.240534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:08.409308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:08.417086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dd13d813-2146-4e6d-bdb3-d88222f09c35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.189544 Jan 15 16:04:08.417683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 604/1202] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:08 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:09.434568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:09.435267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:09.441897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:09.442276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:09.443064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:09.443499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:09.581389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:09.589139 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b60fe50a-4a19-475e-9ebd-689391379444 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158346 Jan 15 16:04:09.589977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 599/1203] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:09 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:10.611685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:10.611685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:10.616758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:10.617688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:10.618568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:10.619552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:10.794242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:10.804692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f0efb3d5-52a5-4ab9-a1ed-11066defe209 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.202109 Jan 15 16:04:10.806590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 605/1204] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:10 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:11.824593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:11.825984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:11.834341 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:11.835098 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:11.836387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:11.837127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:11.984460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:11.993145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-231278aa-6beb-42f8-8926-07b2f43ad915 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.174064 Jan 15 16:04:11.994385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 600/1205] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:11 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:13.010476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:13.011079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:13.017615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:13.018062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:13.018835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:13.019528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:13.160643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:13.168765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-83541725-e051-49bf-b74e-cb33ce161b24 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.161951 Jan 15 16:04:13.169339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 606/1206] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:13 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:14.193155 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:14.196504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:14.211939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:14.212440 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:14.221158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:14.221158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:14.377145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:14.384847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-987d40ad-807e-42b2-8b8f-17200c4630a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.201549 Jan 15 16:04:14.393806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 601/1207] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:14 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:15.402823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:15.403525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:15.412534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:15.413101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:15.414011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:15.414615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:15.563369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:15.571905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-001e8bcc-e943-4b7e-9812-ab0e03e4c879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.173038 Jan 15 16:04:15.575265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 607/1208] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:15 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:16.592562 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:16.593189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:16.600418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:16.600873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:16.601672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:16.602111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:16.757504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:16.766951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-55323a67-2fca-479d-9aa0-159382aa60ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.177557 Jan 15 16:04:16.772665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 602/1209] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:16 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:17.787727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:17.790520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:17.803018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:17.803872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:17.806664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:17.807599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:18.028764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:18.034964 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3ca387e1-ff37-4b8c-aeb2-3efec82a8a88 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.253273 Jan 15 16:04:18.035785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 608/1210] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:17 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:04:19.054460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:19.055728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:19.062553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:19.063765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:19.064799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:19.065243 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:19.234777 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:19.248492 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-95a05e92-a870-4a43-ae6e-356b40fe7042 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.196952 Jan 15 16:04:19.253231 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 603/1211] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:19 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:19.578829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7bf693e9-90aa-4dba-abd9-413a8d01795a tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] Action: 'create', calling method: .version_select at 0x7f21680bd670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1937322022"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:04:19.598561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-7bf693e9-90aa-4dba-abd9-413a8d01795a tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] Getting quotas for project f9f850556ebf48f1b4935adfd84a5bd7. Resources: {'key_pairs'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:04:19.602633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-7bf693e9-90aa-4dba-abd9-413a8d01795a tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] Getting quotas for user 9ffba15864d742a5a028bc506d4e4979 and project f9f850556ebf48f1b4935adfd84a5bd7. Resources: {'key_pairs'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:04:20.046175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-7bf693e9-90aa-4dba-abd9-413a8d01795a tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] Getting quotas for project f9f850556ebf48f1b4935adfd84a5bd7. Resources: {'key_pairs'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:04:20.050041 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-7bf693e9-90aa-4dba-abd9-413a8d01795a tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] Getting quotas for user 9ffba15864d742a5a028bc506d4e4979 and project f9f850556ebf48f1b4935adfd84a5bd7. Resources: {'key_pairs'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:04:20.063095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7bf693e9-90aa-4dba-abd9-413a8d01795a tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.696645 Jan 15 16:04:20.063807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 609/1212] 10.222.0.36 () {60 vars in 1157 bytes} [Sat Jan 15 16:04:19 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:20.270154 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:20.270765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:20.280578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:20.280578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:20.280578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:20.280578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:20.426238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:20.434506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4291d744-1911-4fc0-9f1a-64eeccd9b00b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.168819 Jan 15 16:04:20.435457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 604/1213] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:20 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:21.452202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:21.452827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:21.460467 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:21.460924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:21.461878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:21.462222 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:21.621089 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:21.631714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b0b6047c-668e-462c-9850-39497f9cd685 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.183099 Jan 15 16:04:21.642641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 610/1214] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:21 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:04:22.649577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:22.650196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:22.656532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:22.657523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:22.658315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:22.658735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:22.980987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:22.989870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8e76177b-729d-4297-b0a8-e95bbe234459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.343869 Jan 15 16:04:22.990448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 605/1215] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:22 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:24.006949 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:24.007554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:24.014571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:24.015031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:24.015834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:24.016304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:24.152864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:24.161195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0952fa5e-3d16-40a0-8ecd-6246e0b9443a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158067 Jan 15 16:04:24.162254 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 611/1216] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:24 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:04:25.178189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:25.178843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:25.185188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:25.185669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:25.186448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:25.186891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:25.329182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:25.338371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b4d848e4-994b-46f6-a05f-e6736e8a00f9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.163989 Jan 15 16:04:25.338948 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 606/1217] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:25 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:26.356476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:26.357104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:26.364211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:26.364655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:26.365319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:26.365789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:26.504434 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:26.513098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-34fc4166-4040-4237-9fbd-eed78ddc1adb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.160263 Jan 15 16:04:26.513681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 612/1218] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:26 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:27.530738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:27.531390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:27.539689 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:27.540108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:27.540954 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:27.541401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:27.673251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:27.681199 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0aa894d4-310b-40e7-8ad4-b8c6875e6022 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154298 Jan 15 16:04:27.681757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 607/1219] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:27 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:28.698035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:28.698638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:28.705103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:28.705546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:28.706358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:28.706785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:28.840468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:28.848931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-eeeb7ed2-df35-4a32-9dda-aa0372d7d9ba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154761 Jan 15 16:04:28.849501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 613/1220] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:28 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:29.865871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:29.866609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:29.872945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:29.873389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:29.874162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:29.874596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:30.006855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:30.014654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f81b3b9e-2e0e-48c3-87fb-c2e12ea6aa09 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153045 Jan 15 16:04:30.015207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 608/1221] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:29 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:31.032146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:31.032769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:31.039530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:31.039974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:31.040961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:31.041246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:31.178602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:31.186641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d65a92ad-ea8b-4774-af56-57a7abf8fc2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158246 Jan 15 16:04:31.187219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 614/1222] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:31 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:04:32.204528 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:32.205152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:32.212311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:32.212764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:32.213540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:32.213974 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:32.345154 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:32.352898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-385c4c71-0db4-4fbe-b7b1-5821bf49eca9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152047 Jan 15 16:04:32.353453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 609/1223] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:32 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:33.370492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:33.371407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:33.379201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:33.379812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:33.381012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:33.381651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:33.513433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:33.521892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-72d9bdfd-50aa-4d76-b35b-bbb9ca0ce96c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.155838 Jan 15 16:04:33.522462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 615/1224] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:33 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:34.539282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:34.539899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:34.546131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:34.546580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:34.547352 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:34.547795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:34.683502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:34.686057 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9a1057b0-afe6-4e6b-ad9b-1b1fb7b6f7f1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151207 Jan 15 16:04:34.686615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 610/1225] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:34 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:35.703115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:35.703904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:35.710374 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:35.710819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:35.711589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:35.712022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:35.841965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:35.849823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-14322374-4bb4-4779-b91b-b12ebea7e5ab tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150379 Jan 15 16:04:35.850473 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 616/1226] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:35 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:36.865949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:36.866570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:36.872644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:36.873103 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:36.873894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:36.874340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:37.014911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:37.026795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5a2de342-5eb1-49c6-b700-af1a4f5efef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.164416 Jan 15 16:04:37.027360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 611/1227] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:36 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:38.043686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:38.044331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:38.050691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:38.051286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:38.052068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:38.052530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:38.181602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:38.189249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b669ebc8-f8b4-45c2-892d-cbc6d61d7fe9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149150 Jan 15 16:04:38.189802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 617/1228] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:38 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:39.206919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:39.207472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:39.213693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:39.214143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:39.214915 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:39.215349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:39.344418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:39.352227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f7bdca04-dfdd-4b12-a943-7c2d3992fd47 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149541 Jan 15 16:04:39.352797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 612/1229] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:39 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:40.369244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:40.369788 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:40.375994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:40.376469 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:40.377239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:40.377667 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:40.511318 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:40.520038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d6b964d5-7019-40af-83b8-6205129546ff tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154480 Jan 15 16:04:40.520645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 618/1230] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:40 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:41.537599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:41.538212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:41.544431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:41.544882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:41.545654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:41.546088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:41.671619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:41.679728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-25110c2e-9680-47d6-99dd-ec3cb3400f0a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146426 Jan 15 16:04:41.680315 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 613/1231] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:41 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:42.696786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:42.697376 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:42.703595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:42.704038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:42.704837 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:42.705269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:42.835260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:42.843043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-382dbf09-f35c-4834-9edc-7e30c47e95e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149858 Jan 15 16:04:42.843609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 619/1232] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:42 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:43.859990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:43.860647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:43.867670 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:43.868116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:43.868913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:43.869353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:43.995085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:44.002702 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e1f12179-9600-40c4-8683-81401dd70530 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146410 Jan 15 16:04:44.003919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 614/1233] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:43 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:45.020446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:45.021047 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:45.027500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:45.028008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:45.028935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:45.029394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:45.157562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:45.166020 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1a955a03-7269-4c08-bf0a-785d62cfb18d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150272 Jan 15 16:04:45.166582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 620/1234] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:45 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:46.182264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:46.182873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:46.189099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:46.189577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:46.190351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:46.190907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:46.319369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:46.326934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4f2d70ba-e9b8-4205-a112-91745705c630 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148375 Jan 15 16:04:46.327491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 615/1235] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:46 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:47.345074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:47.346043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:47.353056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:47.353517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:47.354307 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:47.354745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:47.483973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:47.493187 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3efb022a-cec6-4920-a02d-3cfc797465a1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151845 Jan 15 16:04:47.499671 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 621/1236] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:47 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:48.509834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:48.510458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:48.517076 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:48.517488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:48.518540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:48.518987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:48.655849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:48.666614 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-596ac975-26de-424f-a253-a8a9b6458a82 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.160409 Jan 15 16:04:48.667289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 616/1237] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:48 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:49.683983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:49.684632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:49.691690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:49.692153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:49.692934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:49.693368 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:49.823963 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:49.832590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0f6b0ab6-278d-4078-82b0-1ff3b9a18dca tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152103 Jan 15 16:04:49.833153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 622/1238] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:49 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:50.850264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:50.850872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:50.857100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:50.857549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:50.858321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:50.858758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:50.988574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:50.996246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-76d08d3f-b36a-4ace-b744-df776b952eaa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150235 Jan 15 16:04:50.996802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 617/1239] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:50 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:52.013800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:52.014448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:52.021224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:52.021672 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:52.022438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:52.022869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:52.149940 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:52.157709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1649cd10-7644-45ce-b7d3-aa1ae00970c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147671 Jan 15 16:04:52.158278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 623/1240] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:52 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:53.175000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:53.175727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:53.181958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:53.182419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:53.183201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:53.183644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:53.316204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:53.323906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fba122b6-a7e2-45d8-80ee-d5fb8e1ba0f0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153079 Jan 15 16:04:53.324500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 618/1241] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:53 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:54.340326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:54.340914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:54.347484 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:54.347932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:54.348733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:54.349170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:54.475822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:54.483467 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-07704c12-5659-4c0b-8329-046a7c5db2e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146802 Jan 15 16:04:54.484023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 624/1242] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:54 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:55.500853 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:55.501422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:55.508222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:55.508677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:55.509458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:55.509899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:55.635318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:55.643384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5077e733-b36e-47c4-995a-ffe02b7e54be tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146039 Jan 15 16:04:55.644543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 619/1243] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:55 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:56.660853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:56.661475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:56.667814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:56.668292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:56.669062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:56.669495 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:56.801850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:56.809394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4a5407ca-4acb-487a-9fb2-1b769eac40d0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152773 Jan 15 16:04:56.809961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 625/1244] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:56 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:57.826709 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:57.827325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:57.834022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:57.834475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:57.835256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:57.835691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:57.966224 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:57.976099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a6544a11-5997-411b-9efa-b70b17fcccd9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151710 Jan 15 16:04:57.976099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 620/1245] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:57 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:04:58.991568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:04:58.992490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:04:58.998929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:58.999382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:59.000202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:04:59.000633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:04:59.134975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:04:59.142842 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a37c7278-2a03-4a03-9579-866ee695de9b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154954 Jan 15 16:04:59.143974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 626/1246] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:04:58 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:00.160361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:00.161170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:00.174151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:00.174151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:00.174151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:00.174151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:00.299731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:00.307529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9a888c74-5951-4047-8593-7b230ac1ca98 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150817 Jan 15 16:05:00.308100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 621/1247] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:00 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:01.324956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:01.325569 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:01.332430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:01.332873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:01.333670 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:01.334102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:01.461274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:01.469120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cd05221f-b3d8-4758-9406-cbd3cd65e0ac tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147827 Jan 15 16:05:01.469700 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 627/1248] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:01 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:02.485924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:02.486537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:02.493288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:02.493741 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:02.494533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:02.494973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:02.624791 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:02.633202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ba16f403-bdae-4d91-83b9-2b0e5dbef17c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150927 Jan 15 16:05:02.633768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 622/1249] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:02 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:03.650129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:03.650745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:03.656731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:03.657180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:03.657951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:03.658392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:03.784965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:03.792750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bac63d1e-f867-47ee-8f86-ef2b3649989b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146270 Jan 15 16:05:03.793318 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 628/1250] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:03 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:04.810237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:04.810791 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:04.817581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:04.818031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:04.818798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:04.819231 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:04.950136 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:04.957856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cbf41d12-c1bb-495c-bf8a-446b6df3e09a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151400 Jan 15 16:05:04.958420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 623/1251] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:04 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:05:06.071594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:06.072251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:06.078173 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:06.078925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:06.079448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:06.079883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:06.208510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:06.216197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-46e459a9-be2d-4594-ad8c-b8cb9748523b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.245764 Jan 15 16:05:06.216763 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 629/1252] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:05 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:07.233842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:07.234489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:07.240939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:07.241395 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:07.242187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:07.242627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:07.373420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:07.381333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e96c0d6d-c25a-49ef-b683-6eeac94c7110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151144 Jan 15 16:05:07.381907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 624/1253] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:07 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:08.398157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:08.398798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:08.405042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:08.405492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:08.406273 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:08.406711 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:08.534292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:08.542674 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7281c3f8-3d80-40e0-be73-ecd6cc22bf92 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148076 Jan 15 16:05:08.543240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 630/1254] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:08 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:09.565977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:09.566790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:09.572867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:09.573317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:09.574130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:09.574581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:09.703852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:09.712736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3abc97a6-591e-4aed-96a3-5eb37348b558 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150404 Jan 15 16:05:09.713451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 625/1255] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:09 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:10.728974 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:10.729595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:10.735708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:10.736180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:10.736973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:10.737406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:10.870494 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:10.878135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c2f4d911-8576-4c6c-aae4-de0897350d4e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152756 Jan 15 16:05:10.879316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 631/1256] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:10 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:11.895264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:11.895961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:11.902212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:11.902671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:11.903454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:11.903897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:12.030197 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:12.038093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ad17e2e0-06f3-42b4-b9e5-ec0922445122 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147318 Jan 15 16:05:12.038656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 626/1257] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:11 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:13.055232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:13.055856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:13.062279 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:13.062738 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:13.063521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:13.063962 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:13.194755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:13.202394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-550015ea-ae9a-4e5a-b72d-97faad4f9351 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150921 Jan 15 16:05:13.202957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 632/1258] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:13 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:14.219519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:14.220166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:14.226982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:14.227435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:14.228249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:14.228695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:14.357292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:14.365653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d2720263-7624-45cc-8234-06479afeb9bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149765 Jan 15 16:05:14.366224 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 627/1259] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:14 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:15.382952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:15.383561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:15.389927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:15.390374 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:15.391146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:15.391581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:15.518213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:15.526075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-214b3866-5d2e-4422-9047-5f06c7108f99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147497 Jan 15 16:05:15.526639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 633/1260] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:15 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:16.542876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:16.543477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:16.549777 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:16.550902 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:16.552300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:16.552966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:16.682108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:16.689920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4cc3d693-968b-4c90-8eea-75fc6d6c165d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150684 Jan 15 16:05:16.690492 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 628/1261] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:16 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:17.706975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:17.707595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:17.713851 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:17.714305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:17.715119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:17.715586 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:17.842137 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:17.850079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3c5c110b-5b34-46d7-96db-50b78a23383f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146945 Jan 15 16:05:17.850647 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 634/1262] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:17 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:18.868897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:18.869504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:18.876055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:18.876543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:18.877362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:18.877799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:19.016451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:19.025277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-627af1d3-1688-4709-b0d4-ad6f0108de49 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.162353 Jan 15 16:05:19.025849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 629/1263] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:18 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:20.041994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:20.042608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:20.048882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:20.049324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:20.050211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:20.050769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:20.177889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:20.185645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6c83eb82-3016-4a47-af62-e9a5e94c1c71 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147262 Jan 15 16:05:20.186218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 635/1264] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:20 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:21.203336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:21.203945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:21.211093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:21.211537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:21.212349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:21.212784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:21.355723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:21.363841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4f4bcf11-7bfc-49f9-b37c-cec195e760e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.164729 Jan 15 16:05:21.364434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 630/1265] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:21 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:22.380624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:22.381268 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:22.387441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:22.387886 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:22.388693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:22.389125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:22.515336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:22.523830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-132ef429-0278-4e7f-b883-ddfb30919610 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147137 Jan 15 16:05:22.524427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 636/1266] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:22 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:23.542135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:23.542660 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:23.548529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:23.548984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:23.549765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:23.551109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:23.677238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:23.684909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fa498457-a5a0-4444-83b0-2b49532687c3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147080 Jan 15 16:05:23.685465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 631/1267] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:23 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:24.702477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:24.703089 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:24.709618 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:24.710065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:24.710836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:24.711269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:24.840493 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:24.848731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c6b44cf0-6f26-4188-9971-5574e1aecad1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149856 Jan 15 16:05:24.849297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 637/1268] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:24 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:25.866115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:25.866734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:25.872917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:25.873573 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:25.874135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:25.874572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:26.002163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:26.010770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-627e5065-9d50-4fb0-8146-ea06a9bbd2af tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148989 Jan 15 16:05:26.011337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 632/1269] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:25 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:27.028330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:27.029062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:27.035512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:27.035963 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:27.036792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:27.037233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:27.175653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:27.183282 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b9ae8e24-0f20-4b0f-836f-9f7ba3e750f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158727 Jan 15 16:05:27.183848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 638/1270] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:27 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:05:28.201269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:28.202478 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:28.208768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:28.209214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:28.209991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:28.210423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:28.335987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:28.343722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0ee2a95f-97d6-4fcd-9b72-48a3d321670a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146092 Jan 15 16:05:28.344307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 633/1271] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:28 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:29.361955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:29.363195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:29.369627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:29.370077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:29.370850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:29.371287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:29.500068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:29.507891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5a9dc60e-829d-40b5-8b9c-c8afeb7b15e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150072 Jan 15 16:05:29.508488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 639/1272] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:29 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:30.524749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:30.525362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:30.531537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:30.531993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:30.532791 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:30.533227 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:30.670241 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:30.678757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d4e9aad7-e9bd-499b-906b-bcd553ef085d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.157609 Jan 15 16:05:30.679338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 634/1273] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:30 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:31.695370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:31.695988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:31.702533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:31.702990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:31.703827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:31.704299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:31.837231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:31.844965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e81aca49-c0bd-4c2d-a1aa-47118e5cb727 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153198 Jan 15 16:05:31.845471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 640/1274] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:31 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:32.861887 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:32.862479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:32.868867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:32.869369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:32.870159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:32.870659 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:33.000043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:33.008548 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-00262c38-2f4d-4162-92b5-4bf06c79bcc0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150352 Jan 15 16:05:33.009115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 635/1275] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:32 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:34.025021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:34.025645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:34.031835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:34.032338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:34.033120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:34.033582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:34.162045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:34.169788 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f3b986ac-a82d-45b4-8902-eb6b3a10b4c1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148599 Jan 15 16:05:34.170354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 641/1276] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:34 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:35.186833 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:35.187468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:35.194266 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:35.194724 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:35.195594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:35.196039 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:35.323808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:35.331781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c45d7fe1-0154-4348-ac3a-1eb216afdd5b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148957 Jan 15 16:05:35.332378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 636/1277] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:35 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:36.348905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:36.349438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:36.355692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:36.356165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:36.356958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:36.357397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:36.489466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:36.497206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cbd5bf1d-2b95-48e8-84a5-7cb9e81e2a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152168 Jan 15 16:05:36.497773 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 642/1278] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:36 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:37.513924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:37.514492 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:37.521696 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:37.522156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:37.522941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:37.523387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:37.650335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:37.658409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5983763f-81c6-4d23-8eaf-a1d618e273fc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148250 Jan 15 16:05:37.659104 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 637/1279] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:37 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:38.675445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:38.676061 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:38.682300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:38.682751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:38.683538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:38.683975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:38.813981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:38.822640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-65d76b8d-1719-4e04-8aaf-b6c6b72d2194 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151363 Jan 15 16:05:38.823289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 643/1280] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:38 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:39.839647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:39.840285 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:39.846623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:39.847161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:39.847938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:39.848403 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:39.976116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:39.984422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fb8ea337-1e3d-43cd-9830-a0413aefc1c7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148363 Jan 15 16:05:39.984988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 638/1281] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:39 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:41.001812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:41.003115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:41.009597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:41.010052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:41.010839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:41.011280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:41.142105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:41.150140 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a2328de5-7f5f-4818-92e8-96e44c2efa5e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151946 Jan 15 16:05:41.150720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 644/1282] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:40 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:42.166959 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:42.167567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:42.173759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:42.174209 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:42.175239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:42.175682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:42.303179 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:42.311129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3e92e495-3648-434b-86ed-fe7405a23f2b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147736 Jan 15 16:05:42.311769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 639/1283] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:42 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:43.342206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:43.342206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:43.342206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:43.342206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:43.342906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:43.342906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:43.470482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:43.478567 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-29c7704a-88f3-4593-a3ad-f108ca4ba0b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148371 Jan 15 16:05:43.479142 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 645/1284] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:43 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:44.495576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:44.496207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:44.502657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:44.503385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:44.504189 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:44.504630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:44.633128 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:44.640765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c25815c1-737b-421a-acd7-34a8f38031ad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148832 Jan 15 16:05:44.641325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 640/1285] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:44 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:45.658209 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:45.658878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:45.665286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:45.665743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:45.666527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:45.666966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:45.793783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:45.802275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-952a5660-1a1d-470a-8b34-bd279929ed65 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147727 Jan 15 16:05:45.802850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 646/1286] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:45 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:46.819955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:46.820535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:46.826719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:46.827171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:46.827951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:46.828414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:46.958758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:46.966636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0944c307-31c1-4ce0-bb5b-462371aa1490 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150457 Jan 15 16:05:46.967204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 641/1287] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:46 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:47.983616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:47.984256 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:47.990482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:47.990931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:47.991701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:47.992150 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:48.120424 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:48.129212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8699adc5-7792-4429-b55b-3dbb4fb16a59 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149217 Jan 15 16:05:48.129784 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 647/1288] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:47 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:49.146318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:49.146934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:49.153375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:49.153829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:49.154615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:49.155055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:49.286364 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:49.294174 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0c41435e-d134-4c57-961d-a89ff68c03da tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152236 Jan 15 16:05:49.294745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 642/1289] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:49 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:50.311603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:50.312150 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:50.318488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:50.318935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:50.319704 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:50.320154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:50.448528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:50.456661 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-767a632d-b57e-419e-b6db-bab46bf4a006 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148798 Jan 15 16:05:50.457235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 648/1290] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:50 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:51.473616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:51.474242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:51.480553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:51.481011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:51.481797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:51.482239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:51.608070 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:51.615854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9d43275b-742f-4340-ba80-93fb52e31b37 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146530 Jan 15 16:05:51.616488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 643/1291] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:51 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:52.632910 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:52.633441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:52.639579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:52.640030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:52.640831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:52.641262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:52.772023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:52.780087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e0d20bb1-2f0e-4785-bc61-bbfc806d1ef9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150889 Jan 15 16:05:52.780679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 649/1292] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:52 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:53.796679 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:53.797300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:53.804296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:53.804758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:53.805614 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:53.806058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:53.932907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:53.941280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-17d07300-e0b2-4226-948a-1f38b7887874 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147676 Jan 15 16:05:53.942007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 644/1293] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:53 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:54.957669 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:54.958286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:54.964552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:54.965003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:54.965775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:54.966210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:55.096465 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:55.104980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6cca9a96-1b00-447f-8ca2-7451505aee8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150994 Jan 15 16:05:55.105545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 650/1294] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:54 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:56.121787 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:56.122336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:56.129418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:56.129882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:56.130667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:56.131110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:56.258651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:56.266736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-835ded4a-71c5-484a-9aa4-2963a5c4cd8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148484 Jan 15 16:05:56.267297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 645/1295] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:56 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:57.282552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:57.283170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:57.290116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:57.290562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:57.291339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:57.291774 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:57.417533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:57.425571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-346cba0d-fee2-4c0a-8ed8-94cbb51821ae tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146465 Jan 15 16:05:57.426136 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 651/1296] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:57 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:58.442862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:58.443506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:58.449820 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:58.450269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:58.451040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:58.451476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:58.581924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:58.589624 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-54a3e17b-272f-4fbd-a5d7-9d48cbdbb749 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151373 Jan 15 16:05:58.590186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 646/1297] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:58 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:05:59.606341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:05:59.606959 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:05:59.613410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:59.613858 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:59.614638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:05:59.615075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:05:59.741363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:05:59.749405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d5f6fbd3-4d22-48cc-bc7f-7c16ae43db6f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146652 Jan 15 16:05:59.750190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 652/1298] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:05:59 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:00.767321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:00.768058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:00.775064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:00.775517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:00.776338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:00.776783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:00.908693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:00.916622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-95393ccb-4aee-46d0-a4a7-c009aea48df7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153243 Jan 15 16:06:00.917177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 647/1299] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:00 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:01.933527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:01.934118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:01.940435 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:01.940891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:01.941676 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:01.942118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:02.071103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:02.079001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-41ca3fc4-8b5e-4b55-a66a-2cfc601fc110 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149199 Jan 15 16:06:02.079581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 653/1300] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:01 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:03.096300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:03.097527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:03.103882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:03.104371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:03.105158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:03.105600 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:03.236742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:03.244984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9b0e62a1-3f27-4ed9-9a45-a46e1447b10f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152397 Jan 15 16:06:03.252462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 648/1301] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:03 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:04.261675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:04.262415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:04.268944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:04.269572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:04.270354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:04.270788 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:04.404168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:04.412035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c60583f7-1ec8-40db-93dd-0fb71a21b403 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153943 Jan 15 16:06:04.412625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 654/1302] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:04 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:05.429137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:05.429751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:05.435649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:05.436102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:05.436911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:05.437359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:05.564979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:05.573565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4c88b923-0aac-4117-8a98-4bf95dae75fb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148044 Jan 15 16:06:05.574127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 649/1303] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:05 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:06.590085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:06.590722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:06.597883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:06.598321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:06.599088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:06.599518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:06.729112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:06.736716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-43ec5a9d-36da-450f-aabd-bbaa568b50c0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150223 Jan 15 16:06:06.737453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 655/1304] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:06 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:07.753806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:07.754404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:07.760681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:07.761127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:07.761899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:07.762333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:07.889105 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:07.898040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b8cdccb5-cec0-4abc-bff8-e044516b0fad tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148211 Jan 15 16:06:07.898605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 650/1305] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:07 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:08.914614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:08.915230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:08.921575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:08.922038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:08.922769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:08.923203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:09.231665 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:09.240584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5995c887-ef7b-47d9-8839-bea2c7d7c9aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.329456 Jan 15 16:06:09.241006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 656/1306] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:08 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:10.257386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:10.258533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:10.264862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:10.265310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:10.266346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:10.266780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:10.391293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:10.399136 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-427d3b80-e0bb-47ba-95fe-5f05911b1943 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.145394 Jan 15 16:06:10.399698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 651/1307] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:10 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:11.415581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:11.416350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:11.422670 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:11.423112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:11.423883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:11.424372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:11.551450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:11.559125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-52bd62c1-86aa-4962-b265-be561585290e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147139 Jan 15 16:06:11.559695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 657/1308] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:11 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:11.684378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:11.684914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:11.691849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:11.692343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:11.693135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:11.693579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:11.718482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:06:11.990501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d20767c6-d557-4343-9c7d-63808d538947 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 204 len: 0 microversion: 2.20 time: 0.309513 Jan 15 16:06:11.991091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 652/1309] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Jan 15 16:06:11 2022] DELETE /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 16:06:11.998990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:11.999598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:12.005710 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:12.006158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:12.006930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:12.007359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:12.145644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:12.153362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:12.154862 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:12.156087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e802bc80-e8d7-4a41-a152-737b13136e26 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1722 microversion: 2.20 time: 0.160770 Jan 15 16:06:12.156678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 658/1310] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 16:06:11 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 16:06:12.577211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:12.577848 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:12.584258 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:12.584715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:12.585501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:12.585944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:12.718825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:12.727133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3bf69e6c-1651-48e1-9896-da732fa2dbf7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153951 Jan 15 16:06:12.727704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 653/1311] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:12 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:13.175491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:13.176168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:13.182374 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:13.182818 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:13.183606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:13.184025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:13.253459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:13.261501 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:13.263019 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:13.264239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-969950d0-7cc1-4a10-8733-0f529cfbcc4d tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1655 microversion: 2.20 time: 0.093279 Jan 15 16:06:13.270535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 659/1312] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 16:06:13 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 16:06:13.613731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-63d78d4c-4da2-402e-b414-397ac81162c2 req-7afe7600-4cd8-46c8-b200-27499a018914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7455c9-a827-401c-be13-dde30a246560", "name": "network-vif-deleted", "tag": "4fa03a1d-8f3d-4203-9231-350176265ebe"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:06:13.616186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:06:13.616186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:06:13.625333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-63d78d4c-4da2-402e-b414-397ac81162c2 req-7afe7600-4cd8-46c8-b200-27499a018914 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:13.625874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-63d78d4c-4da2-402e-b414-397ac81162c2 req-7afe7600-4cd8-46c8-b200-27499a018914 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:13.638975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-63d78d4c-4da2-402e-b414-397ac81162c2 req-7afe7600-4cd8-46c8-b200-27499a018914 service nova] Creating event network-vif-deleted:4fa03a1d-8f3d-4203-9231-350176265ebe for instance bf7455c9-a827-401c-be13-dde30a246560 on hv-cinder-82481 Jan 15 16:06:13.645668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-63d78d4c-4da2-402e-b414-397ac81162c2 req-7afe7600-4cd8-46c8-b200-27499a018914 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095154 Jan 15 16:06:13.646681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 654/1313] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:06:13.745753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:13.746760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:13.756559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:13.757282 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:13.758325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:13.759167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:13.902532 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:13.912914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-33dc0560-b0c5-491f-8b54-219509ec4352 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.172803 Jan 15 16:06:13.913494 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 660/1314] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:13 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:14.284176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:14.285054 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:14.293381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:14.293755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:14.294564 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:14.295005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:14.332733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:14.333180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:14.333630 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.objects.instance [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lazy-loading 'fault' on Instance uuid bf7455c9-a827-401c-be13-dde30a246560 {{(pid=123221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:06:14.373038 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:14.382158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:14.383679 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b1f031a12243b59ef309631e015afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac4f4ac1e34126997c44b68ff5c47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:14.385238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8358e179-4550-42b5-8c18-b7bcad857224 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 200 len: 1371 microversion: 2.20 time: 0.105757 Jan 15 16:06:14.386012 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 655/1315] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 16:06:14 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 16:06:14.929883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:14.930497 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:14.936876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:14.937268 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:14.938042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:14.938481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:15.069118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:15.076831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cacda343-bfe5-4e45-90d9-fba2f4afd0d5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150718 Jan 15 16:06:15.077410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 661/1316] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:14 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:15.403898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:15.404549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:15.411026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:15.411486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:15.412316 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:15.412764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:15.426316 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] HTTP exception thrown: Instance bf7455c9-a827-401c-be13-dde30a246560 could not be found. Jan 15 16:06:15.426905 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Returning 404 to user: Instance bf7455c9-a827-401c-be13-dde30a246560 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:06:15.427751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d1c508d0-238d-4d47-ac3e-9901a3840995 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 404 len: 111 microversion: 2.20 time: 0.027551 Jan 15 16:06:15.428308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 656/1317] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 16:06:15 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:06:15.436322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-aca81a40-579f-4404-819b-8217ecc9af03 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '.version_select at 0x7f21637a1f70>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:15.517479 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-aca81a40-579f-4404-819b-8217ecc9af03 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268881886" status: 204 len: 0 microversion: 2.20 time: 0.084722 Jan 15 16:06:15.518236 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 662/1318] 10.222.0.36 () {60 vars in 1258 bytes} [Sat Jan 15 16:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268881886 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 16:06:16.094673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:16.095357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:16.103168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:16.103617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:16.104437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:16.104874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:16.312537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:16.320484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-08c39180-458b-45c4-85e3-ed7d32e2b4fa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.229638 Jan 15 16:06:16.321050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 657/1319] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:16 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:17.337907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:17.338517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:17.344410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:17.344860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:17.345638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:17.346417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:17.486275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:17.494689 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-74be4940-0d70-437b-8452-9430d2d45cdb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.160946 Jan 15 16:06:17.495259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 663/1320] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:17 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:18.511921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:18.512558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:18.519773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:18.520252 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:18.521029 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:18.521464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:18.659110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:18.666948 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b36be9ed-ae47-4c32-a752-4cfef9f0b0a5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158619 Jan 15 16:06:18.667519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 658/1321] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:18 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:19.683990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:19.684646 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:19.690995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:19.691454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:19.692283 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:19.692728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:19.825262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:19.833326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d3b5fd8e-86b2-46de-b602-e1ab055a9d6c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153122 Jan 15 16:06:19.834014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 664/1322] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:19 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:20.850389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:20.850936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:20.857109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:20.857561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:20.858334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:20.858765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:20.985977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:20.994264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-648682f0-38a9-4ecc-a994-cd7d42f5996a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147727 Jan 15 16:06:20.994825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 659/1323] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:20 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:22.011428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:22.012041 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:22.019207 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:22.019645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:22.020443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:22.020873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:22.151433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:22.159656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7bac5f41-1489-4476-a63c-b6566f49eade tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152314 Jan 15 16:06:22.161329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 665/1324] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:22 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:23.176866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:23.177485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:23.183611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:23.184068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:23.184955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:23.185427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:23.322719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:23.330429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-69e76487-aeaa-4c06-95ff-d424121e464c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.157838 Jan 15 16:06:23.330990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 660/1325] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:23 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:24.348469 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:24.349093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:24.355476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:24.355925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:24.356741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:24.357186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:24.484609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:24.492514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a6720fa5-dfd5-4d9b-a44d-2107700c0c13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149111 Jan 15 16:06:24.493084 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 666/1326] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:24 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:25.508955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:25.509569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:25.516052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:25.516533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:25.517320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:25.517761 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:25.649394 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:25.657100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8f7f934b-8cf9-4948-ab59-d6bbe7307d94 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151775 Jan 15 16:06:25.657669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 661/1327] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:25 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:26.674747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:26.675356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:26.681842 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:26.682287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:26.683080 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:26.683494 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:26.810445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:26.818063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c645d346-159d-4065-8616-f9c46989f514 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147129 Jan 15 16:06:26.818612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 667/1328] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:26 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:27.834404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:27.835020 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:27.841362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:27.841810 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:27.842583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:27.843015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:27.969811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:27.978519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-251d8a13-52cc-412b-9de8-dec65a0e17b7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147732 Jan 15 16:06:27.979089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 662/1329] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:27 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:28.995596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:28.996304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:29.003180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:29.004331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:29.004449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:29.004839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:29.141271 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:29.149525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-12a87f16-aac0-4124-ba7f-8e7544576ce9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.157583 Jan 15 16:06:29.150090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 668/1330] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:28 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:30.166626 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:30.167424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:30.174541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:30.175018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:30.175877 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:30.176412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:30.301804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:30.309505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-68e140ef-b2e0-479d-b68a-9f52ae7baf26 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146484 Jan 15 16:06:30.310074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 663/1331] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:30 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:31.327364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:31.327971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:31.335014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:31.335664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:31.336475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:31.336912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:31.480193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:31.488941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5b8a2fe4-2f10-4449-a4fc-c34e4551794e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.165313 Jan 15 16:06:31.489512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 669/1332] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:31 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:32.506401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:32.507082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:32.513403 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:32.513803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:32.514578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:32.515015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:32.642234 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:32.650043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8021b7a0-aff7-477a-8a56-4ec04fa0c37d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147408 Jan 15 16:06:32.650607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 664/1333] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:32 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:33.666444 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:33.667052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:33.673013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:33.674264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:33.675045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:33.675476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:33.807250 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:33.815056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-09299196-9612-4a2f-8882-5224b1209801 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152232 Jan 15 16:06:33.815617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 670/1334] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:33 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:34.832300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:34.832914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:34.838715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:34.839216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:34.839932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:34.840405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:34.968300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:34.976368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5be3f467-9195-4dc1-9539-98a9e7c9c4ce tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148200 Jan 15 16:06:34.976932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 665/1335] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:34 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:35.993393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:35.994062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:36.000322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:36.000934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:36.002259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:36.002690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:36.133141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:36.141134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f0b4c114-3b71-47cd-af54-bcc75a064d84 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151632 Jan 15 16:06:36.141695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 671/1336] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:35 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:37.159491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:37.160106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:37.166339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:37.166799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:37.167580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:37.168026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:37.300055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:37.307764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-104b8f4c-6e59-4062-8027-7ff7f9470b18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152937 Jan 15 16:06:37.308348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 666/1337] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:37 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:38.324570 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:38.325177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:38.332259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:38.332703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:38.333480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:38.333914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:38.463321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:38.473758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cfe9c1f8-1e27-48d2-be56-9be81a899775 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150822 Jan 15 16:06:38.473758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 672/1338] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:38 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:39.488895 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:39.489548 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:39.495693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:39.496159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:39.496955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:39.497396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:39.631616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:39.639280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-17d313ee-da77-485b-84ec-daf1e5a23a75 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154200 Jan 15 16:06:39.639844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 667/1339] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:39 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:40.656351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:40.656965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:40.663972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:40.664472 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:40.665249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:40.665677 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:40.791513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:40.799792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ff002d49-e5e7-4e0a-95ca-ed2d9b138e8a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147047 Jan 15 16:06:40.800389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 673/1340] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:40 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:41.817334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:41.817878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:41.823887 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:41.824400 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:41.825180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:41.825645 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:41.951809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:41.960489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5f6c3c10-8efa-4333-a6c9-2d281826e0e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147344 Jan 15 16:06:41.961063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 668/1341] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:41 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:06:42.977676 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:42.978203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:42.984414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:42.984863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:42.985640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:42.986980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:43.117681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:43.125425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6114e7d3-bfea-46e5-9bea-54a7e4f6d108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151469 Jan 15 16:06:43.126155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 674/1342] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:42 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:44.142326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:44.142946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:44.149240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:44.149695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:44.150475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:44.150917 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:44.278461 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:44.286725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ea890787-8b97-4370-8f0a-a10c05239ceb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148292 Jan 15 16:06:44.287291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 669/1343] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:44 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:45.302891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:45.303504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:45.309704 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:45.310160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:45.310917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:45.311348 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:45.440924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:45.448653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5dc0212a-0491-42da-a538-7454e1641297 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149428 Jan 15 16:06:45.449228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 675/1344] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:45 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:46.466014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:46.466756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:46.473490 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:46.473944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:46.474725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:46.475167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:46.603572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:46.611947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-86f44690-028c-43db-9f39-7ac7d9be2341 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149630 Jan 15 16:06:46.612553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 670/1345] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:46 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:47.629785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:47.630329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:47.636648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:47.637092 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:47.637869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:47.638301 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:47.768401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:47.776069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c6a667bf-e0e6-4283-8ee0-8a831e132c18 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150943 Jan 15 16:06:47.776663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 676/1346] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:47 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:48.793023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:48.793669 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:48.800242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:48.800707 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:48.801494 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:48.801936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:48.930261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:48.938190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4a255767-20fc-42e8-a913-7082674754de tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148814 Jan 15 16:06:48.948175 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 671/1347] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:48 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:49.956721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:49.957349 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:49.963557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:49.964031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:49.964850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:49.965290 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:50.093630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:50.102050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-453c62ca-86c2-43b0-b4a7-3ab0eda8cdc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149592 Jan 15 16:06:50.102623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 677/1348] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:49 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:51.118736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:51.119351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:51.125502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:51.125972 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:51.126719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:51.127145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:51.258525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:51.266693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1b626c20-3103-417c-827a-2f6cfd7850f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151485 Jan 15 16:06:51.267427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 672/1349] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:51 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:52.282570 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:52.283335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:52.289733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:52.290184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:52.290965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:52.291404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:52.418213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:52.426452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7b612eb3-2cd8-4394-aa31-dbfa05717b1d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147635 Jan 15 16:06:52.427018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 678/1350] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:52 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:53.443574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:53.444157 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:53.450430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:53.450876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:53.451649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:53.452084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:53.581699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:53.589388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d6359d58-7c2b-44b6-8209-1b18c9e8a29c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149607 Jan 15 16:06:53.589953 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 673/1351] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:53 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:54.606801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:54.607337 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:54.614439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:54.614895 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:54.615674 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:54.616115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:54.752568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:54.760267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3f02acad-4c61-4f90-9e1c-e216d90b11a8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.157243 Jan 15 16:06:54.760833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 679/1352] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:54 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:55.051249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:55.051754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:55.057956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:55.058411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:55.059188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:55.059631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:55.083873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:06:55.388528 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9abf000e-0b04-4485-814e-53829e78678b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 204 len: 0 microversion: 2.1 time: 0.341158 Jan 15 16:06:55.389113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 674/1353] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:06:55 2022] DELETE /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:06:55.397688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:55.398303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:55.404100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:55.405170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:55.405333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:55.405767 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:55.544747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:55.551997 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2da4be18-5431-48c5-8226-6046efe82a46 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1674 microversion: 2.1 time: 0.157944 Jan 15 16:06:55.552602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 680/1354] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:55 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:55.778184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:55.779525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:55.785603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:55.786048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:55.786831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:55.787263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:55.918369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:55.926952 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cbda38ea-e6ef-4122-b10a-dca1b65265b5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153329 Jan 15 16:06:55.927525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 675/1355] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:55 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:56.569158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:56.569770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:56.576095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:56.576568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:56.577343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:56.577775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:56.710581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:56.721051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9d753c47-f826-49dd-9938-c8d5ba08a11a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1674 microversion: 2.1 time: 0.155553 Jan 15 16:06:56.721777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 681/1356] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:56 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:56.958308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:56.958308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:56.958308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:56.958308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:56.959044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:56.959044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:56.959230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-7903ec7f-fa3b-44ee-9dfa-de4210df4dd1 req-73f0abbb-5a3c-423a-9e10-a53d974330d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f56e96-7f77-4614-9eec-3853f80b7c12", "name": "network-vif-deleted", "tag": "f9a8be92-5ef1-4477-bebd-e62518322788"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:06:56.959496 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:06:56.959496 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:06:56.967751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-7903ec7f-fa3b-44ee-9dfa-de4210df4dd1 req-73f0abbb-5a3c-423a-9e10-a53d974330d7 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:56.968129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-7903ec7f-fa3b-44ee-9dfa-de4210df4dd1 req-73f0abbb-5a3c-423a-9e10-a53d974330d7 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:56.979266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-7903ec7f-fa3b-44ee-9dfa-de4210df4dd1 req-73f0abbb-5a3c-423a-9e10-a53d974330d7 service nova] Creating event network-vif-deleted:f9a8be92-5ef1-4477-bebd-e62518322788 for instance 15f56e96-7f77-4614-9eec-3853f80b7c12 on hv-cinder-82481 Jan 15 16:06:56.982845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [req-7903ec7f-fa3b-44ee-9dfa-de4210df4dd1 req-73f0abbb-5a3c-423a-9e10-a53d974330d7 service nova] [f1b76d0c-1dfc-48f2-8efe-d0622797226f] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:06:57.102481 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:57.112924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e5b0cee5-7b47-4065-9754-708b3f1b2791 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.171282 Jan 15 16:06:57.113132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 676/1357] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:56 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:06:57.738333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:57.739193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:57.745293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:57.745748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:57.746590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:57.747032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:57.790261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:57.790978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:57.791427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.objects.instance [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lazy-loading 'fault' on Instance uuid 15f56e96-7f77-4614-9eec-3853f80b7c12 {{(pid=123221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:06:57.834536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3bb74802b3408290f26c129388df24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a446d233d547a699dcdbde99a35548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:57.842261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-98008295-50c5-4fcf-b871-a790f252b453 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 200 len: 1328 microversion: 2.1 time: 0.107726 Jan 15 16:06:57.843551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 677/1358] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:57 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:06:57.990543 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [req-7903ec7f-fa3b-44ee-9dfa-de4210df4dd1 req-73f0abbb-5a3c-423a-9e10-a53d974330d7 service nova] [f1b76d0c-1dfc-48f2-8efe-d0622797226f] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33736. Jan 15 16:06:57.994320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-7903ec7f-fa3b-44ee-9dfa-de4210df4dd1 req-73f0abbb-5a3c-423a-9e10-a53d974330d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040791 Jan 15 16:06:57.995035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 682/1359] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:06:58.129104 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:58.129943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:58.136842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:58.137292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:58.138086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:58.138580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:58.268453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:58.276459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-77a6a0d9-7e41-4ca1-898b-c30220f1bcc3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150987 Jan 15 16:06:58.277033 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 678/1360] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:58 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:06:58.859376 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:58.859996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:58.866169 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:58.866620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:58.867394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:58.867828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:58.882119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] HTTP exception thrown: Instance 15f56e96-7f77-4614-9eec-3853f80b7c12 could not be found. Jan 15 16:06:58.882350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Returning 404 to user: Instance 15f56e96-7f77-4614-9eec-3853f80b7c12 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:06:58.883200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a90b9ab6-5f49-475c-9cdf-06fbc0cf0b0f tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 404 len: 111 microversion: 2.1 time: 0.028359 Jan 15 16:06:58.883912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 683/1361] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:58 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:06:58.892903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6dabdebb-e570-4a6d-a529-76e36ef25ebb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '.version_select at 0x7f21680a45e0>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:58.896129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6dabdebb-e570-4a6d-a529-76e36ef25ebb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [df113b5c-d3eb-4792-b13a-6d7c248fe5fc] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:06:59.293626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:06:59.294140 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:06:59.300070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:59.300558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:59.301337 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:06:59.301773 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:06:59.443531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:06:59.451315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-41b16314-2429-4886-ba3e-3d8d4bf44381 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.161446 Jan 15 16:06:59.451882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 684/1362] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:06:59 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:06:59.904164 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [None req-6dabdebb-e570-4a6d-a529-76e36ef25ebb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [df113b5c-d3eb-4792-b13a-6d7c248fe5fc] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33762. Jan 15 16:06:59.989596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6dabdebb-e570-4a6d-a529-76e36ef25ebb tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562003703" status: 202 len: 0 microversion: 2.1 time: 1.101392 Jan 15 16:06:59.990173 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 679/1363] 10.222.0.36 () {58 vars in 1220 bytes} [Sat Jan 15 16:06:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562003703 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:07:00.471298 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:00.472686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:00.487865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:00.488360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:00.489167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:00.489613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:00.630439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:00.638858 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0dd634f8-3569-4202-bab2-610e8c154c44 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.172413 Jan 15 16:07:00.639432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 685/1364] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:00 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:01.658035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:01.661203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:01.665612 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:01.666072 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:01.666856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:01.667290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:01.796516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:01.805129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1ddffe8a-e565-4026-bcb4-a72c2c4911e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151244 Jan 15 16:07:01.805706 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 680/1365] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:01 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:02.822626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:02.823270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:02.830396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:02.830925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:02.831709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:02.832167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:02.961379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:02.968961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-95acf95f-b4d7-44c4-989a-37df98d97df9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150100 Jan 15 16:07:02.969573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 686/1366] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:02 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:03.987108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:03.987731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:03.994036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:03.994488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:03.995303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:03.995744 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:04.125324 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:04.137168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7d10641f-4283-4e8d-9e6d-6f4a71eec3a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.155142 Jan 15 16:07:04.137737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 681/1367] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:03 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:05.154686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:05.155302 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:05.161953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:05.162405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:05.163186 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:05.163627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:05.293403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:05.302042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e12c9f7f-bccd-4d72-b986-16334375f879 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150884 Jan 15 16:07:05.302468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 687/1368] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:05 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:06.318866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:06.319515 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:06.325366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:06.325821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:06.326606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:06.327044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:06.458077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:06.465868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-418d2e9e-370d-404b-a2d7-f01283b43ff3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150809 Jan 15 16:07:06.466434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 682/1369] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:06 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:07.482603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:07.483216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:07.490251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:07.490702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:07.491476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:07.491911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:07.616227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:07.623867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-12c165d8-fa16-44c6-9854-2717241ba41f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.144987 Jan 15 16:07:07.624464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 688/1370] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:07 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:08.640692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:08.642170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:08.648467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:08.648923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:08.649709 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:08.650152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:08.778443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:08.787326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-34c64cde-42d2-4d1a-8791-ea6a8124ac50 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150558 Jan 15 16:07:08.787893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 683/1371] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:08 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:09.803922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:09.804580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:09.810840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:09.811196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:09.811972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:09.812440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:09.942507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:09.950344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-29bb06df-f5a1-444a-9378-e61f9f9f73e0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149997 Jan 15 16:07:09.950910 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 689/1372] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:09 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:10.966603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:10.967211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:10.973471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:10.973919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:10.974712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:10.975147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:11.102920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:11.111178 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-95ca8187-0fe8-4c27-87bb-d3daaa4ddd78 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148227 Jan 15 16:07:11.111729 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 684/1373] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:10 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:12.127068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:12.127691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:12.134063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:12.134519 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:12.135304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:12.135747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:12.264714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:12.272802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dd69d697-7299-43b4-84f2-80046b2e5074 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149512 Jan 15 16:07:12.273375 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 690/1374] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:12 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:13.289695 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:13.290260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:13.296743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:13.297772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:13.298612 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:13.299482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:13.426558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:13.434001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-550a535e-09ff-4cfb-90de-e4744d0813e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148042 Jan 15 16:07:13.434570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 685/1375] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:13 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:14.450938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:14.451561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:14.458202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:14.458654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:14.459436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:14.459932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:14.591317 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:14.599189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3245136f-34aa-4734-a48d-8760f5128959 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151942 Jan 15 16:07:14.599752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 691/1376] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:14 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:15.615696 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:15.616274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:15.622736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:15.623191 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:15.624016 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:15.624510 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:15.753824 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:15.761447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cec82d31-d54d-49c8-b89e-ecb9962d36aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149486 Jan 15 16:07:15.762013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 686/1377] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:15 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:16.779394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:16.780569 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:16.787379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:16.787824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:16.788643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:16.789076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:16.915841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:16.924468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-59a6a9f9-7294-4d29-9fc1-3e943d1dd5a0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148673 Jan 15 16:07:16.930604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 692/1378] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:16 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:17.945925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:17.946537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:17.952831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:17.953299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:17.954294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:17.954733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:18.084934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:18.092627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6071befa-d96b-4658-80a4-50c34a2fe944 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150325 Jan 15 16:07:18.093190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 687/1379] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:17 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:19.110020 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:19.110746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:19.117054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:19.117504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:19.118281 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:19.118721 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:19.246299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:19.255003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-97f4db4e-f5b5-44c0-b8c3-7f1696b5656a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149227 Jan 15 16:07:19.255564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 693/1380] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:19 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:20.321262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:20.321954 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:20.328191 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:20.329222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:20.330000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:20.330433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:20.459746 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:20.468822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-352e4ede-d429-493c-8a85-4ff00d57e332 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151053 Jan 15 16:07:20.469667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 688/1381] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:20 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:21.486498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:21.487110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:21.493425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:21.493872 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:21.494637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:21.495096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:21.622243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:21.630664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-34ae2996-e4b8-4c55-a7ce-5f168c6fcb8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148545 Jan 15 16:07:21.631232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 694/1382] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:21 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:22.647757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:22.648403 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:22.654725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:22.655180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:22.655961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:22.656918 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:22.786751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:22.794458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ab9107d9-fbfe-427a-b935-b753e44e3dc4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150310 Jan 15 16:07:22.795023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 689/1383] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:22 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:23.811508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:23.812175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:23.819192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:23.819647 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:23.820471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:23.820912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:23.956939 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:23.963045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-933848bd-7e13-4b8c-a8e6-cf626ba25089 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.155062 Jan 15 16:07:23.963616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 695/1384] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:23 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:24.980165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:24.980807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:24.987710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:24.988220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:24.989007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:24.989446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:25.115466 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:25.123653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-76b3ae4b-c69c-4e10-a004-c84b136623f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147160 Jan 15 16:07:25.124248 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 690/1385] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:24 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:26.141678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:26.142319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:26.148565 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:26.149008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:26.149779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:26.150207 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:26.285451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:26.293224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0b00b6a6-a5d2-47c5-a861-b1c3dce13cec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.155905 Jan 15 16:07:26.293804 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 696/1386] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:26 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:27.310339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:27.310952 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:27.317426 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:27.317875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:27.318657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:27.319089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:27.447265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:27.455611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c98f9752-9229-42c6-8d56-4c2c99256459 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148777 Jan 15 16:07:27.456201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 691/1387] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:27 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:28.473045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:28.473648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:28.479873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:28.480355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:28.481128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:28.481562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:28.784219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:28.791985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-70348c83-0d18-4975-b5ab-ba79c7c4f34e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.323538 Jan 15 16:07:28.792583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 697/1388] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:28 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:29.809168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:29.809783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:29.816123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:29.816656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:29.817428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:29.817864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:29.945742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:29.954613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-81d07f8c-4dc3-4e82-a06a-3a746377034e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149018 Jan 15 16:07:29.955176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 692/1389] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:29 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:30.970657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:30.971620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:30.978153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:30.978602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:30.979383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:30.979818 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:31.107236 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:31.115759 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-97a10d4c-1318-4926-b816-dc480f974fbd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149007 Jan 15 16:07:31.116359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 698/1390] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:30 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:32.132984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:32.133631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:32.140855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:32.141407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:32.142195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:32.142636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:32.272551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:32.282446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-19ed4bac-b51c-425b-ab4c-182d47230f2e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153071 Jan 15 16:07:32.283015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 693/1391] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:32 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:33.300012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:33.300697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:33.307062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:33.307508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:33.308311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:33.308745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:33.436223 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:33.444030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-79590ce7-2b76-4a62-9dbc-23f4f79bb5f5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148677 Jan 15 16:07:33.444640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 699/1392] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:33 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:34.462065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:34.462722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:34.469206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:34.470217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:34.471014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:34.471454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:34.603354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:34.611806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0a1cf156-864a-4e9d-b849-92b4204af9eb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153776 Jan 15 16:07:34.612425 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 694/1393] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:34 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:35.629412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:35.629953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:35.635964 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:35.636476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:35.637257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:35.637697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:35.770149 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:35.777870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-35bf563a-c76d-442f-a862-c4535ea32453 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152645 Jan 15 16:07:35.778422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 700/1394] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:35 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:07:36.794401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:36.795015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:36.804380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:36.805290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:36.806300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:36.806745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:36.942014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:36.950217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9af164a0-6846-4a00-8cb1-1c5c5b5fd401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.159390 Jan 15 16:07:36.950731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 695/1395] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:36 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:37.966783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:37.967311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:37.974243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:37.974697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:37.975478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:37.975919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:38.105404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:38.112968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0423bbc8-6f7a-4358-b175-0bdb818b4e99 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149986 Jan 15 16:07:38.113537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 701/1396] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:37 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:39.130059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:39.130672 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:39.136819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:39.137267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:39.138039 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:39.138472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:39.265804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:39.274285 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-797dfde3-47cd-4d00-9b61-aaf252c663bd tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148262 Jan 15 16:07:39.275606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 696/1397] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:39 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:40.290469 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:40.291088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:40.297563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:40.298016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:40.298796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:40.299231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:40.439201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:40.439201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e15fda2a-c676-40ee-a934-461ffd230ca5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150981 Jan 15 16:07:40.439201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 702/1398] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:40 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:41.455292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:41.455850 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:41.463052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:41.463508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:41.464413 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:41.464805 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:41.593710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:41.602411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ac1bc700-1241-4d35-806f-f41209e4cf35 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150959 Jan 15 16:07:41.602979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 697/1399] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:41 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:42.619557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:42.620085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:42.626971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:42.627425 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:42.628260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:42.628701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:42.759266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:42.767512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-584b60e9-4549-47c2-a1b8-4fdbf64c30b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151697 Jan 15 16:07:42.768070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 703/1400] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:42 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:43.784245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:43.784861 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:43.791115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:43.791568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:43.792501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:43.792941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:43.919118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:43.927409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-77e8916a-34ac-43c1-bac0-5be0b72d52db tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146980 Jan 15 16:07:43.927978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 698/1401] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:43 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:44.944833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:44.945471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:44.951799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:44.952113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:44.952908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:44.953340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:45.088082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:45.096874 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5c37f1ae-1a67-4eb7-8a65-8b9a636b48a6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.155625 Jan 15 16:07:45.097633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 704/1402] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:44 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:46.113783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:46.114407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:46.120685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:46.121137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:46.121923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:46.122366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:46.254947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:46.262667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a37d545e-3aa9-4dd1-8941-aa84b2448f41 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152631 Jan 15 16:07:46.263232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 699/1403] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:46 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:47.280486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:47.281143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:47.288004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:47.288522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:47.289388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:47.289781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:47.415566 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:47.424021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9786a735-3fab-44d2-bd01-1779de3efdc7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147157 Jan 15 16:07:47.429397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 705/1404] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:47 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:48.441685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:48.442298 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:48.448530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:48.448992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:48.449776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:48.450217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:48.580852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:48.588466 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7b471c87-80ac-4244-8d09-6b5bc5784784 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151078 Jan 15 16:07:48.589026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 700/1405] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:48 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:49.604296 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:49.604910 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:49.611278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:49.611722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:49.612522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:49.612957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:49.740036 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:49.747647 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-efeccd30-ab6b-4218-83e1-2dfbceed1b5d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146940 Jan 15 16:07:49.748223 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 706/1406] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:49 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:50.765085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:50.765696 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:50.772609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:50.773165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:50.774021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:50.774460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:50.904290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:50.912003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8b90c40d-4e87-48d4-b242-bd33345031e7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150856 Jan 15 16:07:50.912604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 701/1407] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:50 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:51.928815 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:51.929468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:51.935666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:51.936122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:51.936933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:51.937375 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:52.066566 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:52.074266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a10335ff-0087-4b16-976d-f80ac070cf7e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149084 Jan 15 16:07:52.074829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 707/1408] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:51 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:53.091897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:53.092551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:53.098933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:53.099391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:53.100209 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:53.100655 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:53.230099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:53.236545 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d93fd205-896e-4fb5-9e09-4212218e713c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148287 Jan 15 16:07:53.237118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 702/1409] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:53 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:54.254111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:54.254653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:54.260879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:54.261328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:54.262104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:54.262540 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:54.395374 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:54.403070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3d2b732d-9808-4aeb-896d-ac1626145eea tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153203 Jan 15 16:07:54.403639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 708/1410] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:54 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:55.420309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:55.420920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:55.427490 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:55.427965 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:55.428794 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:55.429229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:55.556102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:55.564806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ef1d20ec-f123-4c9f-a130-3b9d698f0a1c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148183 Jan 15 16:07:55.565365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 703/1411] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:55 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:56.582004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:56.582595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:56.588818 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:56.589265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:56.590029 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:56.590462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:56.723183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:56.731014 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-472c7242-c459-499c-b919-52d1ea9ed76f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153268 Jan 15 16:07:56.731582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 709/1412] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:56 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:57.747467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:57.748079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:57.754591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:57.755048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:57.755828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:57.756291 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:57.883566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:57.892009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a2ec398b-cfdb-48fd-8133-907a1f39507a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148057 Jan 15 16:07:57.892621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 704/1413] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:57 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:07:58.909332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:07:58.909937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:07:58.916063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:58.919728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:58.919728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:07:58.919728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:07:59.048305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:07:59.056051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cac7f7c7-42ef-4007-a0b0-8ccaf0531b34 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150951 Jan 15 16:07:59.056653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 710/1414] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:07:58 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:00.073429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:00.074313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:00.082005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:00.082253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:00.083045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:00.083511 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:00.220432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:00.228129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8d8b4029-7069-4398-9881-8e239a140d06 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158558 Jan 15 16:08:00.228704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 705/1415] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:00 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:01.244919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:01.255182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:01.255182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:01.255182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:01.255182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:01.255679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:01.383592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:01.390612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c2b92a4f-b4a2-4584-b125-6ac5b1384492 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149434 Jan 15 16:08:01.394054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 711/1416] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:01 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:02.408115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:02.408750 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:02.415193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:02.415650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:02.416471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:02.416940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:02.550034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:02.557659 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-84b7a380-0559-4f9f-80be-f57b81da27fe tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153465 Jan 15 16:08:02.558217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 706/1417] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:02 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:03.574775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:03.575393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:03.581600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:03.582044 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:03.582809 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:03.583243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:03.710705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:03.718458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-00ff9753-40e9-4ad4-a81e-49e10ee40278 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147564 Jan 15 16:08:03.719530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 712/1418] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:03 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:04.735989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:04.736628 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:04.742423 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:04.742869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:04.743637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:04.744067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:04.875427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:04.883330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-681c140f-44d2-47e1-84b5-3ccff682681b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151497 Jan 15 16:08:04.883892 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 707/1419] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:04 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:05.900669 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:05.901264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:05.907611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:05.908055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:05.908853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:05.909285 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:06.036243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:06.043848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7761fc2d-5424-4fe8-86e4-fff73d082aba tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146847 Jan 15 16:08:06.044454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 713/1420] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:05 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:07.060943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:07.061590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:07.068596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:07.069055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:07.069849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:07.070292 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:07.201398 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:07.209975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4926990c-fbe3-49b4-ac46-31f8eadf26c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152673 Jan 15 16:08:07.210556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 708/1421] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:07 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:08.227476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:08.228100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:08.235100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:08.235692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:08.236504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:08.236937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:08.368114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:08.376087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6a8bd3c1-15ec-4ee2-a64d-2c0a5959b18a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152268 Jan 15 16:08:08.376688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 714/1422] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:08 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:09.392930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:09.393567 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:09.399736 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:09.400220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:09.401009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:09.401447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:09.530187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:09.538409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d5d781a1-bec0-4b60-83a9-02689eb9275f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149242 Jan 15 16:08:09.538975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 709/1423] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:09 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:10.554445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:10.555055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:10.561489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:10.561937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:10.563232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:10.564054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:10.695954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:10.703751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bb338a60-9596-4007-9b1f-49ae3479b6f8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152939 Jan 15 16:08:10.704337 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 715/1424] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:10 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:08:11.721090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:11.721704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:11.728051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:11.728531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:11.729305 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:11.729737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:11.855901 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:11.863637 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8866b2da-5d0f-4957-9a4a-a45ccf935c8b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147029 Jan 15 16:08:11.864288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 710/1425] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:11 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:12.880450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:12.881068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:12.887299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:12.888008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:12.888803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:12.889233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:13.014934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:13.023404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3f9e48d4-f12c-4dd6-a013-2532eaee635d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146519 Jan 15 16:08:13.024007 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 716/1426] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:12 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:08:14.041043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:14.041665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:14.048602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:14.049056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:14.049839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:14.050276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:14.181077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:14.188823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-79e51583-f586-45d2-a3b2-a8de44297bcf tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151498 Jan 15 16:08:14.189386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 711/1427] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:14 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:15.206595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:15.207208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:15.213605 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:15.214057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:15.214814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:15.215246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:15.351923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:15.360405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5f08fb07-9808-43b5-ba04-565113f25971 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158330 Jan 15 16:08:15.360967 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 717/1428] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:15 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:16.378076 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:16.378664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:16.385222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:16.385667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:16.386431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:16.386862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:16.516707 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:16.524727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-07964795-e63c-4ca9-9d0c-14d9b565f4d4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151230 Jan 15 16:08:16.525294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 712/1429] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:16 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:17.541313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:17.541919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:17.548862 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:17.549316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:17.550100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:17.550534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:17.676483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:08:17.677050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:08:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:08:17.681241 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:17.690533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9dbe0a12-698c-4261-8e3d-bedff0d2529f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152834 Jan 15 16:08:17.691111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 718/1430] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:17 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:18.707267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:18.707989 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:18.714241 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:18.714783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:18.715478 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:18.715911 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:18.866269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:18.874138 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9eb00ea7-ac99-4099-a126-ad0f15e8a027 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.171360 Jan 15 16:08:18.875146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 713/1431] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:18 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:19.892201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:19.892822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:19.899096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:19.899547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:19.900351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:19.900793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:20.031931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:20.040717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8aaeebc2-75ed-45b3-a577-1213599ba8e5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152062 Jan 15 16:08:20.041181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 719/1432] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:19 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:21.058040 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:21.058681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:21.065149 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:21.065594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:21.066366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:21.066803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:21.193245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:21.200907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-67e1f0ec-6b02-444e-8ad4-eadc19516dc8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146531 Jan 15 16:08:21.201467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 714/1433] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:21 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:22.217537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:22.218847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:22.225260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:22.225715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:22.226500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:22.226944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:22.361801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:22.369514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fbeec322-72a2-4f06-990d-24b9a1864d2d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.155647 Jan 15 16:08:22.370076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 720/1434] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:22 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:23.386554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:23.387168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:23.394067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:23.394519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:23.395300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:23.395737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:23.522034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:23.529884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-84acb3b1-889f-4bae-a196-9544c8db2dcc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146963 Jan 15 16:08:23.531063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 715/1435] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:23 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:24.328919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:08:24.329614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:08:24.547117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:24.547727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:24.560442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:24.560442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:24.560442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:24.560442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:24.692413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:24.700152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3941b106-666c-46b1-a52b-d4e43cbb60b1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.157263 Jan 15 16:08:24.700717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 721/1436] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:24 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:25.716422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:25.717036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:25.723578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:25.724024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:25.724827 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:25.725262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:25.851309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:25.859738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-84bbe0e4-9588-41ff-a3b7-29eec20d00ec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146913 Jan 15 16:08:25.860517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 716/1437] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:25 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:26.877143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:26.877681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:26.883898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:26.884386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:26.885173 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:26.885617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:27.013482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:27.021409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-36d8df28-edcd-4334-9b5b-263675e9f91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148633 Jan 15 16:08:27.021971 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 722/1438] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:26 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:28.039002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:28.040756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:28.048267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:28.048970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:28.050543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:28.050990 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:28.185172 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:28.193386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d8e02e30-fa67-4f4e-8332-6fae517de76e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158416 Jan 15 16:08:28.193961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 717/1439] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:28 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:29.210703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:29.211314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:29.217272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:29.217720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:29.218735 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:29.219173 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:29.359807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:29.361755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e682412e-2758-42af-ac8b-adb56f37f27d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154622 Jan 15 16:08:29.362334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 723/1440] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:29 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:30.379019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:30.379665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:30.385957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:30.386414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:30.387456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:30.387898 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:30.518267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:30.526162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d8b23c2-d8e5-4ab4-bb73-2f3fb45e88df tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150756 Jan 15 16:08:30.526740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 718/1441] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:30 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:31.542286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:31.542950 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:31.549532 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:31.549981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:31.550763 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:31.551199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:31.684009 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:31.692547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-734e9702-2d2a-480b-9e8c-edabb5765ce4 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153867 Jan 15 16:08:31.693108 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 724/1442] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:31 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:32.709797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:32.710501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:32.717009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:32.717745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:32.718534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:32.719030 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:32.852631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:32.861058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-65b05319-4f0a-4f59-8196-72ccaa46ada7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.155388 Jan 15 16:08:32.861632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 719/1443] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:32 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:33.841892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jan 15 16:08:33.842436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:08:33.880017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:33.880651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:33.888839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:33.890178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:33.891028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:33.891464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:34.019575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:34.027344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8ba62355-3a46-40b6-99b9-4b1a8989ac0c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152561 Jan 15 16:08:34.027904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 725/1444] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:33 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:35.044960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:35.046079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:35.052005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:35.052518 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:35.053303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:35.053738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:35.180846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:35.189086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-91a0d8c0-db3b-4f19-9633-d7e697c1a5d3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148005 Jan 15 16:08:35.189655 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 720/1445] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:35 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:36.206183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:36.206794 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:36.212650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:36.213091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:36.213861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:36.214296 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:36.343956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:36.351535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9403ba8a-97e1-4df6-9b50-f09f4a35609e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149043 Jan 15 16:08:36.352088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 726/1446] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:36 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:37.368662 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:37.369282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:37.376994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:37.377456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:37.378241 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:37.378679 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:37.508824 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:37.517051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1a11f09a-a906-44a0-9161-ae0b93dda939 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152120 Jan 15 16:08:37.517725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 721/1447] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:37 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:08:38.534970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:38.535589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:38.541962 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:38.542416 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:38.543202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:38.543643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:38.672002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:38.679720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e87af3ae-9210-4358-a0df-00439852e338 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148619 Jan 15 16:08:38.680306 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 727/1448] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:38 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:39.696797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:39.697420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:39.703802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:39.704290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:39.705082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:39.705521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:39.841509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:39.849979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-768b447a-a737-4892-84b4-ee31a83e3d86 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.156894 Jan 15 16:08:39.850555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 722/1449] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:39 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:40.866331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:40.867141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:40.873835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:40.874381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:40.875177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:40.875618 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:41.008592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:41.017541 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fa157a3d-5f73-49d0-be2a-76e0ecd7f0d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154848 Jan 15 16:08:41.018111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 728/1450] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:40 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:42.035218 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:42.035940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:42.042496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:42.043019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:42.043881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:42.044457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:42.177094 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:42.184790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c6db08c2-1557-4cdc-ad2e-d320c27a01b2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153602 Jan 15 16:08:42.185357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 723/1451] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:42 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:43.201026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:43.202693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:43.208729 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:43.209185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:43.209968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:43.210413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:43.341602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:43.350538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-aab2c824-eed5-4734-aeef-2e86a7d2426d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153167 Jan 15 16:08:43.351103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 729/1452] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:43 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:44.367945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:44.368586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:44.375041 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:44.375493 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:44.376311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:44.376748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:44.506814 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:44.515279 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-858ed11a-5089-46f0-861d-492a78c4621a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151031 Jan 15 16:08:44.516457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 724/1453] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:44 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:45.532366 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:45.533013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:45.539538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:45.539986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:45.540791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:45.541229 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:45.668048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:45.676492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c5188502-a0c2-41c4-8e6b-5aacb8354462 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147893 Jan 15 16:08:45.677065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 730/1454] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:45 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:46.693367 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:46.693987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:46.700313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:46.700776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:46.701588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:46.702026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:46.831994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:46.839762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-246aa2af-137f-4026-a835-f2cb305be401 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150032 Jan 15 16:08:46.840361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 725/1455] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:46 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:47.856998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:47.858159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:47.864685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:47.865132 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:47.865902 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:47.866336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:47.991245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:47.999006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a734567b-6539-4491-b339-e07d041c9172 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.145648 Jan 15 16:08:47.999563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 731/1456] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:47 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:49.016362 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:49.016973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:49.023172 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:49.023626 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:49.024471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:49.024914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:49.153014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:49.161614 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5c4081a7-9b6a-4cd2-bafe-a56787ddb1c5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149902 Jan 15 16:08:49.162397 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 726/1457] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:49 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:50.179578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:50.180232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:50.187549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:50.187995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:50.188817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:50.189260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:50.324920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:50.333775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-98bb140c-f398-453d-a2c9-5dcef9fc201f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.157813 Jan 15 16:08:50.334764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 732/1458] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:50 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:51.351053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:51.352090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:51.358588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:51.359093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:51.359922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:51.360320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:51.494948 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:51.503611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ba8c3921-8c01-4e73-8139-c6008a86557a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.156353 Jan 15 16:08:51.504194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 727/1459] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:51 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:52.520163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:52.520790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:52.527372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:52.527827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:52.528651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:52.529096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:52.663091 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:52.671379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-55f66f3b-bd7d-4ce8-8648-d774a00c45b3 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154995 Jan 15 16:08:52.671937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 733/1460] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:52 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:53.688852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:53.689471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:53.695679 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:53.696157 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:53.696956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:53.697400 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:53.822960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:53.831795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d7741cda-6ce0-4509-9fe1-a37419df796c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147328 Jan 15 16:08:53.832396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 728/1461] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:53 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:54.848644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:54.849231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:54.855429 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:54.855888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:54.856706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:54.857144 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:54.983998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:54.991686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d30d787b-bc63-4b8c-8641-40c0b08aef25 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146755 Jan 15 16:08:54.992272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 734/1462] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:54 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:56.007711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:56.008359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:56.015593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:56.016049 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:56.016843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:56.017277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:56.146540 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:56.156023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-da4528cb-3944-4d74-96e5-e696de416c14 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151916 Jan 15 16:08:56.156619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 729/1463] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:56 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:57.174135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:57.174750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:57.181085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:57.181537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:57.182343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:57.182779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:57.311258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:57.318962 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-12d873fb-6623-48d4-a348-690cad0ba0b8 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149171 Jan 15 16:08:57.319535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 735/1464] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:57 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:58.336339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:58.336888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:58.343416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:58.343873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:58.344683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:58.345123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:58.473275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:58.480888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d5e18b0f-c4bf-4790-ac60-813b08405873 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.148305 Jan 15 16:08:58.481442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 730/1465] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:58 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:08:59.499213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:08:59.499819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:08:59.506100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:59.506547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:59.507312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:08:59.507743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:08:59.633379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:08:59.642054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f6e5c350-a1d8-4ccf-a7ca-ceaa9becd81f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147177 Jan 15 16:08:59.642616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 736/1466] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:08:59 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:00.659119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:00.659737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:00.666056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:00.666509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:00.667288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:00.667730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:00.798071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:00.806113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b9ea25c1-92f7-481f-869d-491e19cff7e6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150686 Jan 15 16:09:00.806862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 731/1467] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:00 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:01.822576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:01.823270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:01.830149 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:01.830591 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:01.831383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:01.831822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:01.961280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:01.970877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-06fb77a2-b4ad-4908-a3eb-d872f162306e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152080 Jan 15 16:09:01.971459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 737/1468] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:01 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:02.987956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:02.988653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:02.994949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:02.995477 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:02.996368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:02.996832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:03.175623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:03.183249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-595e4a84-6667-4063-a26c-de0daf9a46d2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.199165 Jan 15 16:09:03.183804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 732/1469] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:02 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:04.200639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:04.201601 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:04.207460 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:04.207907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:04.208706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:04.209138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:04.386530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:04.394319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-91569755-be36-418c-954f-65e4363131bc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.197497 Jan 15 16:09:04.394885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 738/1470] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:04 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:05.411184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:05.411798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:05.417628 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:05.418080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:05.418865 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:05.419307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:05.545065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:05.552791 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4563a7a9-2b2c-410a-b15a-4708338c0246 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.145406 Jan 15 16:09:05.553357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 733/1471] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:05 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:06.570325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:06.570913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:06.577535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:06.578167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:06.578946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:06.579412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:06.714869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:06.726268 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-05f26427-c59a-481a-8c61-8a8b7ea277a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.159839 Jan 15 16:09:06.726853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 739/1472] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:06 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:07.743960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:07.744602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:07.751417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:07.751868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:07.752674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:07.753116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:07.879813 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:07.887821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-68c8aae9-5462-403e-bfa8-5059d7a0aabc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147441 Jan 15 16:09:07.888522 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 734/1473] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:07 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:08.904603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:08.905392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:08.911336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:08.911782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:08.912590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:08.913028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:09.041081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:09.049449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-55cfb7d7-115e-47bb-bcb7-2a3d9c39239a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149016 Jan 15 16:09:09.050038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 740/1474] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:08 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:10.066582 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:10.067194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:10.073390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:10.073844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:10.074615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:10.075046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:10.205802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:10.213659 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-111f0cac-db35-449b-a05c-aceac063fe8c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150696 Jan 15 16:09:10.214237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 735/1475] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:10 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:11.232622 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:11.233239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:11.239433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:11.239875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:11.240673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:11.241106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:11.372265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:11.380764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-89a1c10e-aba9-4dd6-9d3c-eb04b44bc108 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151996 Jan 15 16:09:11.381490 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 741/1476] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:11 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:12.398127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:12.398841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:12.404927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:12.405375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:12.406150 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:12.406584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:12.539613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:12.548067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3e5d9156-a989-4d44-90fd-b73e6b953dcb tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.153473 Jan 15 16:09:12.548683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 736/1477] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:12 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:13.565249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:13.565862 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:13.572202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:13.572654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:13.573430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:13.573862 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:13.698770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:13.706624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8a71f6f7-3ad0-4bcf-bf5f-1e83f635cc6e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.144965 Jan 15 16:09:13.707185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 742/1478] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:13 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:14.723041 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:14.723580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:14.729804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:14.730251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:14.731020 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:14.731454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:14.859111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:14.866781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8bdab773-87d3-4ed9-8644-54b3e3eab8c6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147460 Jan 15 16:09:14.867345 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 737/1479] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:14 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:15.886202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:15.886822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:15.893951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:15.894393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:15.895158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:15.895590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:16.197252 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:16.205153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-45a727b8-5edb-4499-923d-6ca415272b67 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.322811 Jan 15 16:09:16.205719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 743/1480] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:15 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:17.221207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:17.221825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:17.228102 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:17.228586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:17.229369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:17.229809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:17.356320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:17.364039 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0d135ee8-6bd9-48ca-8c5b-188c7dcd9f4f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146539 Jan 15 16:09:17.365079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 738/1481] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:17 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:18.381547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:18.382095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:18.389331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:18.389779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:18.390552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:18.390986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:18.522122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:18.529836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-faa4ff56-89f2-4a7e-874c-7507c9423b30 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152063 Jan 15 16:09:18.530464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 744/1482] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:18 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:19.547408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:19.548026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:19.554534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:19.555143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:19.556474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:19.557206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:19.685696 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:19.693768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3c68e035-2a68-4d92-b4af-b192c72b2804 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150830 Jan 15 16:09:19.694337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 739/1483] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:19 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:20.710352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:20.710975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:20.718199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:20.718660 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:20.719451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:20.719890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:20.852953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:20.860805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-67265565-159c-4552-ab9d-eacb256fa66b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154055 Jan 15 16:09:20.861378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 745/1484] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:20 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:21.878080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:21.878699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:21.884871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:21.885329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:21.886374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:21.886812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:22.015981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:22.023676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ed0832bf-ff19-45bd-aac4-8caae57145c2 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149222 Jan 15 16:09:22.024263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 740/1485] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:21 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:23.040457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:23.041079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:23.047424 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:23.047873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:23.048707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:23.049147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:23.174012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:23.181686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5e9a4ed2-f719-4939-a843-78bab5e89d3b tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.144823 Jan 15 16:09:23.182256 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 746/1486] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:23 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:24.199169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:24.199807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:24.206881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:24.207328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:24.208101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:24.208634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:24.337244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:24.344966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6729aee8-7afd-4dba-80f2-fa3da5f6a319 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149417 Jan 15 16:09:24.345539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 741/1487] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:24 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:25.361705 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:25.362249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:25.368487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:25.368934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:25.369713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:25.370239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:25.497347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:25.508660 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7fd7c594-3893-4af6-bb09-db6b9f704eec tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150644 Jan 15 16:09:25.509280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 747/1488] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:25 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:26.527253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:26.527862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:26.535024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:26.535470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:26.536276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:26.536713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:26.665651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:26.673468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3cca5729-8798-4ac9-8dbd-27ab68b6ec13 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149855 Jan 15 16:09:26.674031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 742/1489] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:26 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:27.690325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:27.690942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:27.697315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:27.697768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:27.698542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:27.698981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:27.824787 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:27.832459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-32a365eb-1e30-41c3-a1d7-8fe84564c437 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.145830 Jan 15 16:09:27.833027 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 748/1490] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:27 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:28.849240 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:28.849836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:28.856620 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:28.857088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:28.857872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:28.858309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:28.993642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:29.002526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d1489b3b-e9f8-482a-b57e-dd0d6dbe1f76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.156997 Jan 15 16:09:29.003093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 743/1491] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:28 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:30.019621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:30.020251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:30.026904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:30.027350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:30.028126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:30.028735 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:30.155054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:30.162849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e0155d42-04b7-4e13-8151-41b84b72c7e1 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146852 Jan 15 16:09:30.163417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 749/1492] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:30 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:31.179619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:31.180293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:31.187414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:31.187872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:31.188691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:31.189136 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:31.321401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:31.330200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ba9cb14e-4365-4439-b837-adf9cf74b7a9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154215 Jan 15 16:09:31.330777 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 744/1493] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:31 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:32.346934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:32.347611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:32.354233 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:32.354683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:32.355460 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:32.355897 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:32.507813 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:32.516728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1b8d842f-99e3-4d6e-bd0f-bdd4a2eaf992 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.173454 Jan 15 16:09:32.517292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 750/1494] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:32 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:33.533657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:33.534278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:33.540571 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:33.541028 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:33.541815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:33.542261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:33.667657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:33.675997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d4e5ea8f-9ff9-4f2b-b8e1-58451b38d1b9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.145971 Jan 15 16:09:33.676590 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 745/1495] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:33 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:34.693261 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:34.693881 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:34.700604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:34.701145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:34.701925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:34.702361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:34.834540 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:34.842436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d2ff21e6-4da3-423f-a241-c79145cea7dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152827 Jan 15 16:09:34.843003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 751/1496] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:34 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:35.859606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:35.860246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:35.866145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:35.866592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:35.867365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:35.867800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:35.994682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:36.003086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-310a7a75-d960-419b-ae9c-7d43af7cb91a tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147710 Jan 15 16:09:36.003656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 746/1497] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:35 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:37.020740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:37.021332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:37.027829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:37.028926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:37.029730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:37.030172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:37.157062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:37.164701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-492a2f87-ab53-42e7-b461-0dcb18902d6d tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147748 Jan 15 16:09:37.165260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 752/1498] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:37 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:38.181533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:38.182146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:38.189168 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:38.189621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:38.190407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:38.190875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:38.324371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:38.332779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-da7fdcd4-74e4-4050-acbd-443b0ec6dfe6 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154958 Jan 15 16:09:38.333348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 747/1499] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:38 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:39.349776 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:39.350370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:39.356638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:39.357640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:39.358414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:39.358845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:39.485182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:39.492907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e890f514-e943-4adc-b0f8-3a25551bb0aa tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146869 Jan 15 16:09:39.493508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 753/1500] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:39 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:40.510676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:40.511306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:40.518207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:40.518658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:40.519433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:40.519868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:40.653664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:40.661565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4da4ae4f-4111-4f5b-9ec2-b83a17357be0 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154806 Jan 15 16:09:40.671053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 748/1501] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:40 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:41.678237 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:41.678844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:41.686104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:41.686564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:41.687369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:41.687775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:41.819220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:41.829585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0689aaf1-884a-4a63-a72d-b5e6646e1a01 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154954 Jan 15 16:09:41.830337 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 754/1502] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:41 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:42.847199 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:42.847818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:42.854104 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:42.854563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:42.855349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:42.855792 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:42.988460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:42.996578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bf9777ae-5bff-40e4-8232-baf513e37309 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152744 Jan 15 16:09:42.997271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 749/1503] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:42 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:44.013772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:44.014404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:44.020730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:44.021184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:44.021969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:44.022413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:44.152722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:44.160907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7761f244-0161-4c41-b135-00f925dfefe7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151105 Jan 15 16:09:44.161475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 755/1504] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:44 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:09:45.177970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:45.178582 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:45.185259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:45.185806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:45.186618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:45.187024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:45.313753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:45.321402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d9947a56-5073-4cac-9d6c-3ac9cad03672 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146992 Jan 15 16:09:45.321967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 750/1505] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:45 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:46.338779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:46.339393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:46.346285 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:46.346740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:46.347521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:46.347965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:46.478871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:46.486882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5ea1c28e-a727-4a57-9294-e9488002d60c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151809 Jan 15 16:09:46.487436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 756/1506] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:46 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:47.503848 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:47.504406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:47.511021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:47.511482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:47.512311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:47.513279 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:47.643613 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:47.651357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9fc148d5-8434-41be-a391-3a6e6787881c tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151322 Jan 15 16:09:47.651914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 751/1507] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:47 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:48.668575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:48.669426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:48.675942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:48.676411 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:48.677179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:48.677610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:48.807000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:48.815364 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3cc40665-6c0d-4d38-b2ec-d66dfe6a8941 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.150440 Jan 15 16:09:48.815941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 757/1508] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:48 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:49.832316 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:49.832931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:49.839183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:49.839632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:49.840502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:49.841688 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:49.969034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:49.976665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-98622cab-11ca-4179-81d5-fe55f0bb6966 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147997 Jan 15 16:09:49.977228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 752/1509] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:49 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:50.994013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:50.994628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:51.001367 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:51.001816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:51.002595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:51.003027 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:51.128905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:51.136798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f8bba718-3437-4d56-bc4f-5c4765543ab9 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.146545 Jan 15 16:09:51.137361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 758/1510] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:50 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:52.155202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:52.155815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:52.162073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:52.162523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:52.163296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:52.163732 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:52.294872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:52.302582 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3a298fb7-572b-4cc7-a772-e95d49c652dc tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.151960 Jan 15 16:09:52.303350 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 753/1511] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:52 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:53.325715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:53.325715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:53.333604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:53.339511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:53.339511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:53.339511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:53.466252 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:53.474225 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-055cee31-1764-4d12-919f-49a3e4efc170 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.158421 Jan 15 16:09:53.474805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 759/1512] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:53 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:54.491433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:54.492194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:54.498538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:54.498993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:54.499809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:54.500220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:54.636886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:54.644821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ecd80d71-17cf-4c13-abce-3b89e4e2e15e tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.156958 Jan 15 16:09:54.645572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 754/1513] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:54 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:55.667313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:55.667946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:55.675162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:55.675616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:55.676450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:55.676894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:55.822150 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:55.830552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f847cb1a-500f-4812-bfe2-dca0e566da76 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.171613 Jan 15 16:09:55.834194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 760/1514] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:55 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:56.849497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:56.850111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:56.857740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:56.858190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:56.858966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:56.859678 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:56.991525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:56.999719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3cde50fd-9c5c-4a60-bcb7-021c0b083d31 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.154615 Jan 15 16:09:57.002671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 755/1515] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:56 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:58.016631 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:58.017300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:58.023744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:58.024226 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:58.025015 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:58.025452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:58.153890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:58.161663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b8c91412-3c7b-4020-9805-6e040ddf8d91 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.149533 Jan 15 16:09:58.162245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 761/1516] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:58 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:09:59.178469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:09:59.179078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:09:59.185571 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:59.186021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:59.186796 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:09:59.187233 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:09:59.318578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:09:59.326991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4f22f2b0-2b81-44f6-b683-485d4539e8a7 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152118 Jan 15 16:09:59.336304 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 756/1517] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:09:59 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:10:00.343487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:10:00.344109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:10:00.350504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:10:00.350947 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:10:00.351750 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:10:00.352212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:10:00.484698 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:10:00.492662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e3f5ba73-5447-43a5-982c-0d9c12f1bf16 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.152948 Jan 15 16:10:00.493221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 762/1518] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:10:00 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:10:01.511373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:10:01.512076 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:10:01.520531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:10:01.520531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:10:01.521239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:10:01.521682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:10:01.662663 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:10:01.670656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aea80881-a016-4b3f-ab94-8c6943468ad5 tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.163987 Jan 15 16:10:01.671238 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 757/1519] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:10:01 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:10:02.687048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:10:02.687988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] [instance: 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:10:02.694213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:10:02.694653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:10:02.695427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:10:02.695865 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:10:02.822367 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a03f52dc174b96b3612476a35f3833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4121a00783af445eafdcb3f976604c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:10:02.830787 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c59f2d3e-1b5c-4e8f-996a-cde538475b0f tempest-VolumesSnapshotTestJSON-452625514 tempest-VolumesSnapshotTestJSON-452625514-project] 10.222.0.36 "GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0" status: 200 len: 1560 microversion: 2.1 time: 0.147902 Jan 15 16:10:02.831354 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 763/1520] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:10:02 2022] GET /compute/v2.1/servers/5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:10:54.309183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:10:54.309735 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:10:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:11:01.992430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:11:01.992975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:11:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:11:18.225435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:11:18.225983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:12:16.960760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 16:12:16.964032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:12:16.964557 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:12:16.971166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:12:16.972407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:12:16.972407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:12:16.972859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:12:16.986814 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] HTTP exception thrown: Instance bf7455c9-a827-401c-be13-dde30a246560 could not be found. Jan 15 16:12:16.987404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Returning 404 to user: Instance bf7455c9-a827-401c-be13-dde30a246560 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:12:16.988258 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0210ea54-70ec-4215-94f3-14ae8d4ba0b0 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 404 len: 111 microversion: 2.20 time: 0.029649 Jan 15 16:12:16.988789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 758/1521] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Jan 15 16:12:16 2022] DELETE /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:12:16.994663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [-] [14db0917-d513-4ff7-a257-d7f8104704fb] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 16:12:16.998457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:12:17.007056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: bf7455c9-a827-401c-be13-dde30a246560] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:12:17.007056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:12:17.007056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:12:17.007056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:12:17.007457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:12:17.020003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] HTTP exception thrown: Instance bf7455c9-a827-401c-be13-dde30a246560 could not be found. Jan 15 16:12:17.020638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Returning 404 to user: Instance bf7455c9-a827-401c-be13-dde30a246560 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:12:17.021485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-71071621-3099-4638-9c0a-5bd3a1b3b3d2 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560" status: 404 len: 111 microversion: 2.20 time: 0.028700 Jan 15 16:12:17.022002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 764/1522] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 16:12:16 2022] GET /compute/v2.1/servers/bf7455c9-a827-401c-be13-dde30a246560 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 15 16:12:54.008242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38272. Jan 15 16:12:54.157250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-d591626b-fc09-4b97-ac10-67d8b88b216e req-89854f94-8173-44d7-83e9-944a230074b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0", "name": "network-vif-deleted", "tag": "4a1a9294-08f3-4060-8d7f-017bd388f212"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:12:54.159214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:12:54.159214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:12:54.167253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-d591626b-fc09-4b97-ac10-67d8b88b216e req-89854f94-8173-44d7-83e9-944a230074b1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:12:54.167744 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-d591626b-fc09-4b97-ac10-67d8b88b216e req-89854f94-8173-44d7-83e9-944a230074b1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:12:54.179293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-d591626b-fc09-4b97-ac10-67d8b88b216e req-89854f94-8173-44d7-83e9-944a230074b1 service nova] Creating event network-vif-deleted:4a1a9294-08f3-4060-8d7f-017bd388f212 for instance 5cb10a96-93aa-4e81-9f3d-c6f2cd5ab5a0 on hv-cinder-82481 Jan 15 16:12:54.186050 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-d591626b-fc09-4b97-ac10-67d8b88b216e req-89854f94-8173-44d7-83e9-944a230074b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188918 Jan 15 16:12:54.186635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 759/1523] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:13:01.655833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:13:01.656394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:13:01.663602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:13:01.664044 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:13:01.664875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:13:01.665312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:13:01.680203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] [14db0917-d513-4ff7-a257-d7f8104704fb] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38366. Jan 15 16:13:01.681669 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] HTTP exception thrown: Instance 15f56e96-7f77-4614-9eec-3853f80b7c12 could not be found. Jan 15 16:13:01.682266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Returning 404 to user: Instance 15f56e96-7f77-4614-9eec-3853f80b7c12 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:13:01.683102 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-660b9f58-2e96-4441-ba7c-b1e1f74cd0c5 tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 404 len: 111 microversion: 2.1 time: 0.030966 Jan 15 16:13:01.683642 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 765/1524] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:13:01 2022] DELETE /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:13:01.694963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:13:01.694963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 15f56e96-7f77-4614-9eec-3853f80b7c12] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:13:01.699539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:13:01.700013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:13:01.700809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:13:01.701257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:13:01.714417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] HTTP exception thrown: Instance 15f56e96-7f77-4614-9eec-3853f80b7c12 could not be found. Jan 15 16:13:01.715004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Returning 404 to user: Instance 15f56e96-7f77-4614-9eec-3853f80b7c12 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:13:01.715829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-58f94642-2f6a-4615-90a8-f4cd4507a01b tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12" status: 404 len: 111 microversion: 2.1 time: 0.028054 Jan 15 16:13:01.716390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 760/1525] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:13:01 2022] GET /compute/v2.1/servers/15f56e96-7f77-4614-9eec-3853f80b7c12 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:13:17.688042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:13:17.690093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:13:24.338065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:13:24.338599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:13:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:13:33.849732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:13:33.850392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:13:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:15:54.316768 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:15:54.317284 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:16:00.653184 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:00.653694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:00.659786 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:00.660257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:00.661030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:00.661459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:00.685723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:16:00.887611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [f1b76d0c-1dfc-48f2-8efe-d0622797226f] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:16:01.897043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [f1b76d0c-1dfc-48f2-8efe-d0622797226f] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 40508. Jan 15 16:16:02.015985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fbe19924-84f5-4768-8d13-bc64de0f7506 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 204 len: 0 microversion: 2.1 time: 1.367131 Jan 15 16:16:02.016587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 766/1526] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:16:00 2022] DELETE /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 0 bytes in 1369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:16:02.022889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 16:16:02.029886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:02.029886 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:02.040707 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:02.041249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:02.042063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:02.042676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:02.315270 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:02.322611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2be77ff8-0f5a-4a20-8984-d3daa56028c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1507 microversion: 2.1 time: 0.301639 Jan 15 16:16:02.323180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 761/1527] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:02 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:03.349160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-0ea0f981-315b-4dde-a631-4d4374670222 req-4e6d517d-9100-487a-9c5b-d124afa8f34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a436d761-1adc-477e-b18c-cf92ca8a7acc", "name": "network-vif-deleted", "tag": "300c880f-2fc9-4f7e-9677-0ec892ca7a68"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:16:03.350762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:16:03.350762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:16:03.358002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:03.359580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:03.367893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-0ea0f981-315b-4dde-a631-4d4374670222 req-4e6d517d-9100-487a-9c5b-d124afa8f34f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:03.368090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:03.368391 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:03.368552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-0ea0f981-315b-4dde-a631-4d4374670222 req-4e6d517d-9100-487a-9c5b-d124afa8f34f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:03.369187 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:03.369634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:03.381594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-0ea0f981-315b-4dde-a631-4d4374670222 req-4e6d517d-9100-487a-9c5b-d124afa8f34f service nova] Creating event network-vif-deleted:300c880f-2fc9-4f7e-9677-0ec892ca7a68 for instance a436d761-1adc-477e-b18c-cf92ca8a7acc on hv-cinder-82481 Jan 15 16:16:03.385308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [req-0ea0f981-315b-4dde-a631-4d4374670222 req-4e6d517d-9100-487a-9c5b-d124afa8f34f service nova] [23f1be4a-413a-457f-b321-ff03f7f83f0e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:16:03.385913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 40554. Jan 15 16:16:03.545087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:03.554641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-31346c4e-a241-43a1-8cee-c73914858835 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 200 len: 1465 microversion: 2.1 time: 0.215486 Jan 15 16:16:03.554641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 767/1528] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:03 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 1465 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:04.393708 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [req-0ea0f981-315b-4dde-a631-4d4374670222 req-4e6d517d-9100-487a-9c5b-d124afa8f34f service nova] [23f1be4a-413a-457f-b321-ff03f7f83f0e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 40574. Jan 15 16:16:04.397489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-0ea0f981-315b-4dde-a631-4d4374670222 req-4e6d517d-9100-487a-9c5b-d124afa8f34f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.054763 Jan 15 16:16:04.398093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 762/1529] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:16:04.570583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:04.571178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: a436d761-1adc-477e-b18c-cf92ca8a7acc] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:04.577802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:04.578272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:04.579379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:04.580052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:04.593911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] HTTP exception thrown: Instance a436d761-1adc-477e-b18c-cf92ca8a7acc could not be found. Jan 15 16:16:04.595640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Returning 404 to user: Instance a436d761-1adc-477e-b18c-cf92ca8a7acc could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:16:04.596519 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-25ef497d-fbb4-4be4-a301-86e6fa7cc53a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc" status: 404 len: 111 microversion: 2.1 time: 0.029680 Jan 15 16:16:04.597138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 768/1530] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:04 2022] GET /compute/v2.1/servers/a436d761-1adc-477e-b18c-cf92ca8a7acc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:16:04.605533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:04.606156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:04.613412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:04.613776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:04.614588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:04.615004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:04.652822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:16:04.965215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9de71ded-16cd-4778-a9a9-8a1893013d38 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 204 len: 0 microversion: 2.1 time: 0.363518 Jan 15 16:16:04.965872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 763/1531] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:16:04 2022] DELETE /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:16:04.973760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:04.974394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:04.980227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:04.980707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:04.981535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:04.982013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:05.191575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:05.211925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-22d9d1fe-d328-4977-9e52-e5c2604f88ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.241794 Jan 15 16:16:05.212543 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 769/1532] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:06.231449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:06.232969 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:06.242044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:06.243101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:06.244232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:06.245063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:06.549434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:06.558868 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8ce8c890-8580-4df7-a245-dcc4e71bcb8b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1567 microversion: 2.1 time: 0.331846 Jan 15 16:16:06.559462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 764/1533] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:06.576216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-1938776a-0a76-46ca-8a67-50960c841588 req-7063baa7-ab55-426b-b4e4-60e9fd63cfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9275a1-4d53-4571-be72-2b4524364e4a", "name": "network-vif-deleted", "tag": "b4c26bef-3b98-4971-99aa-f32d1efad8ab"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:16:06.577741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:16:06.577741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:16:06.586902 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-1938776a-0a76-46ca-8a67-50960c841588 req-7063baa7-ab55-426b-b4e4-60e9fd63cfef service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:06.587753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-1938776a-0a76-46ca-8a67-50960c841588 req-7063baa7-ab55-426b-b4e4-60e9fd63cfef service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:06.599860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-1938776a-0a76-46ca-8a67-50960c841588 req-7063baa7-ab55-426b-b4e4-60e9fd63cfef service nova] Creating event network-vif-deleted:b4c26bef-3b98-4971-99aa-f32d1efad8ab for instance ba9275a1-4d53-4571-be72-2b4524364e4a on hv-cinder-82481 Jan 15 16:16:06.605018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-1938776a-0a76-46ca-8a67-50960c841588 req-7063baa7-ab55-426b-b4e4-60e9fd63cfef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 Jan 15 16:16:06.606788 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 770/1534] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:16:07.574824 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:07.575581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:07.583063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:07.583625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:07.584516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:07.585177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:07.678448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:07.687642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ac1a7873-86ba-4c2d-a66f-6ec8f592754c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.116614 Jan 15 16:16:07.689151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 765/1535] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:08.706779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:08.708081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:08.717221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:08.717933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:08.718942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:08.719610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:08.791464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:08.800580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dddd38c5-6afd-40f4-95f3-657bf352d134 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.099140 Jan 15 16:16:08.801159 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 771/1536] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:09.816836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:09.823257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:09.824160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:09.824636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:09.825723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:09.826166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:09.896757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:09.910435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f3fa04b4-441d-4c26-93bb-ec00ff97adcd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.097377 Jan 15 16:16:09.911014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 766/1537] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:10.927192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:10.927968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:10.937276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:10.938686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:10.940434 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:10.941230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:11.021678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:11.032983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b70e857e-2404-485d-b2f8-55c381ffe6af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.109364 Jan 15 16:16:11.033926 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 772/1538] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:12.050318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:12.050935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:12.057680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:12.058141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:12.059127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:12.059609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:12.150026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:12.158336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-096e75e7-c4a4-4dcc-baee-8bf5ee3a0063 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.111893 Jan 15 16:16:12.158923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 767/1539] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:13.174562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:13.175244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:13.181668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:13.182119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:13.182925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:13.183371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:13.246312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:13.256928 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cdf3ebeb-1f2b-494b-aa88-b25bf5fd63ec tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085938 Jan 15 16:16:13.257685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 773/1540] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:14.274206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:14.275414 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:14.284085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:14.284569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:14.285361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:14.285797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:14.377277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:14.388105 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bf11f24e-6f95-4b69-a353-211c894df006 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.117421 Jan 15 16:16:14.389012 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 768/1541] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:15.407267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:15.411232 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:15.418187 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:15.418881 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:15.420183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:15.420848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:15.525467 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:15.533700 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9719637c-76e8-489c-be17-f6e2994cbf50 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.130412 Jan 15 16:16:15.534507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 774/1542] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:16.549405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:16.550683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:16.563402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:16.564108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:16.565204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:16.565855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:16.634766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:16.645714 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e43d45c6-05f0-4c29-9f02-4897aec059df tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.099504 Jan 15 16:16:16.646771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 769/1543] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:17.662251 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:17.663838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:17.678475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:17.678921 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:17.679712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:17.680165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:17.753146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:17.763310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8ab8a0c8-d234-4f45-b9de-89c1a06ef439 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.104646 Jan 15 16:16:17.764326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 775/1544] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:18.780586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:18.782184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:18.788653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:18.789449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:18.790652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:18.791304 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:18.855395 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:18.866067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9d921539-ce96-4599-b553-0d06cecb7350 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.089376 Jan 15 16:16:18.874456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 770/1545] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:19.893476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:19.894917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:19.903822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:19.904386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:19.905244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:19.906394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:19.980157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:19.989198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b679a2d9-e615-4cc5-be8d-70c3575df0d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.108223 Jan 15 16:16:19.992538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 776/1546] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:21.008433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:21.009757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:21.017912 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:21.018454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:21.019335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:21.019914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:21.092206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:21.102249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-735ce024-3bbb-401b-a246-a453835c8b98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.098972 Jan 15 16:16:21.111648 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 771/1547] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:22.119478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:22.120104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:22.128873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:22.129553 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:22.130522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:22.130955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:22.204648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:22.213480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-49907540-31fe-4330-8342-f4014d326632 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.098878 Jan 15 16:16:22.223896 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 777/1548] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:23.231129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:23.231649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:23.239778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:23.240276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:23.241390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:23.242073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:23.318131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:23.326626 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2601cdc7-42ef-403a-afcf-3e541ea87981 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.099016 Jan 15 16:16:23.327109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 772/1549] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:24.344073 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:24.345446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:24.352080 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:24.352835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:24.353864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:24.354562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:24.421024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:24.430180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3e05b62c-ac82-4af8-bfdb-adfe8e9659a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.089972 Jan 15 16:16:24.439947 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 778/1550] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:25.446978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:25.447624 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:25.454922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:25.455380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:25.456201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:25.456649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:25.527684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:25.535616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4b4eb87d-bc34-4fe8-98aa-92387c075352 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.092490 Jan 15 16:16:25.536196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 773/1551] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:26.552191 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:26.552806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:26.559116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:26.559560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:26.560357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:26.560792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:26.622347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:26.631476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5873b610-f4e9-4fcf-8453-11c7e7677989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083013 Jan 15 16:16:26.632032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 779/1552] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:26.880632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-caf9ee66-ffb7-41ef-bbbc-225d8a9e0ff1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Action: 'create', calling method: .version_select at 0x7f216811e040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1431965039"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:16:26.895272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-caf9ee66-ffb7-41ef-bbbc-225d8a9e0ff1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Getting quotas for project c854f3c8a7a343dd81194043bbdec268. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:16:26.900045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-caf9ee66-ffb7-41ef-bbbc-225d8a9e0ff1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Getting quotas for user 6dbb31e0372546b480ecd798079d6b35 and project c854f3c8a7a343dd81194043bbdec268. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:16:27.206251 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-caf9ee66-ffb7-41ef-bbbc-225d8a9e0ff1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Getting quotas for project c854f3c8a7a343dd81194043bbdec268. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:16:27.209930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-caf9ee66-ffb7-41ef-bbbc-225d8a9e0ff1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Getting quotas for user 6dbb31e0372546b480ecd798079d6b35 and project c854f3c8a7a343dd81194043bbdec268. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:16:27.222873 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-caf9ee66-ffb7-41ef-bbbc-225d8a9e0ff1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.349048 Jan 15 16:16:27.223465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 774/1553] 10.222.0.36 () {60 vars in 1157 bytes} [Sat Jan 15 16:16:26 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:27.271381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1099677745", "imageRef": "69708b9a-ccb7-4ccf-a458-3e922405c6ae", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1431965039", "networks": [{"uuid": "8c9aca41-92e0-4d04-ab52-67a85ecf9310"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:16:27.319527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] validate_networks() for [('8c9aca41-92e0-4d04-ab52-67a85ecf9310', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 16:16:27.647954 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:27.648597 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:27.654404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:27.654860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:27.655641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:27.656727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:27.733337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:27.741274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6e99a6e0-f36e-4aaf-b36f-3fcc774880c9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.096961 Jan 15 16:16:27.741843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 775/1554] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:27.797119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 16:16:27.797614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 16:16:27.798119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 16:16:27.798525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 16:16:27.798932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 16:16:27.808531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:27.808979 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:27.809798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:27.810253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:27.826603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Getting quotas for project c854f3c8a7a343dd81194043bbdec268. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:16:27.831168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Getting quotas for user 6dbb31e0372546b480ecd798079d6b35 and project c854f3c8a7a343dd81194043bbdec268. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:16:27.842056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 16:16:27.844634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69708b9a-ccb7-4ccf-a458-3e922405c6ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 16:16:27.946127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [b002c091-6545-4502-89b2-70da13e60023] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:16:28.758349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:28.758966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:28.765344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:28.765894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:28.766680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:28.767123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:28.827078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:28.835297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-781a38e1-961f-4f94-b7f4-b74ac36cc7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080576 Jan 15 16:16:28.835859 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 776/1555] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:28.953720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [b002c091-6545-4502-89b2-70da13e60023] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 40748. Jan 15 16:16:28.957572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0e3854dc-a179-4b5f-8c97-000bdd6059a8 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689888 Jan 15 16:16:28.958438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 780/1556] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 16:16:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 16:16:28.968208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ecfabd16-0cfa-4bf7-93a7-9c03c88b1807 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:28.969435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ecfabd16-0cfa-4bf7-93a7-9c03c88b1807 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:29.020056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ecfabd16-0cfa-4bf7-93a7-9c03c88b1807 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:29.026835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ecfabd16-0cfa-4bf7-93a7-9c03c88b1807 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1259 microversion: 2.1 time: 0.062645 Jan 15 16:16:29.031474 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 777/1557] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:28 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1259 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:29.853123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:29.853643 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:29.860038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:29.860513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:29.861283 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:29.861715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:29.924121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:29.931805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-73f76089-e5f8-4d26-ab08-05cfc6e3f768 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082899 Jan 15 16:16:29.932405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 781/1558] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:30.044035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-29895e63-1502-4144-b165-37dc9b647e68 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:30.044686 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-29895e63-1502-4144-b165-37dc9b647e68 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:30.098430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-29895e63-1502-4144-b165-37dc9b647e68 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:30.106245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-29895e63-1502-4144-b165-37dc9b647e68 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1259 microversion: 2.1 time: 0.065776 Jan 15 16:16:30.107301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 778/1559] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:30 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:30.949245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:30.949864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:30.956455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:30.956911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:30.957694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:30.958137 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:31.018436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:31.026329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4e48d207-eba1-4a69-887e-416c5b76e303 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080780 Jan 15 16:16:31.026895 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 782/1560] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:31.123057 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-09997991-e72a-480c-964a-32c5b24653bf tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:31.123674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-09997991-e72a-480c-964a-32c5b24653bf tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:31.174524 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-09997991-e72a-480c-964a-32c5b24653bf tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:31.180958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-09997991-e72a-480c-964a-32c5b24653bf tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1259 microversion: 2.1 time: 0.061524 Jan 15 16:16:31.181511 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 779/1561] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:31 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1259 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:32.042811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:32.043454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:32.050274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:32.050715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:32.051483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:32.051914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:32.111542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:32.119284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-79dce107-7d2c-4836-828a-a9d84a5a26d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080273 Jan 15 16:16:32.119972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 783/1562] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:32.197591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-891a46fb-45f7-46e4-adfc-0e30cd075863 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:32.198201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-891a46fb-45f7-46e4-adfc-0e30cd075863 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:32.250739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-891a46fb-45f7-46e4-adfc-0e30cd075863 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:32.257118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-891a46fb-45f7-46e4-adfc-0e30cd075863 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1259 microversion: 2.1 time: 0.063206 Jan 15 16:16:32.257700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 780/1563] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:32 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1259 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:33.136219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:33.136789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:33.143114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:33.143557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:33.144504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:33.144944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:33.208238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:33.216016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-01e1ddc4-2645-497f-9a93-91390f0e7e0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083519 Jan 15 16:16:33.216613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 784/1564] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:33.273851 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:33.274472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:33.281260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:33.282351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:33.282588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:33.282939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:33.340737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:33.348577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-40e65bd4-174c-4d89-b3a1-f40df089fc5c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1263 microversion: 2.1 time: 0.078515 Jan 15 16:16:33.349140 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 781/1565] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:33 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:34.232830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:34.233443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:34.239853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:34.240353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:34.241128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:34.241564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:34.301170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:34.308930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d56a07d4-cb8c-4403-9b4d-9a58906bedcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079730 Jan 15 16:16:34.309493 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 785/1566] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:34.365472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:34.366128 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:34.372465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:34.372939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:34.373730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:34.374177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:34.435538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:34.443745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6041c9cc-168a-4857-ba82-dc669bfb06d7 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1263 microversion: 2.1 time: 0.082090 Jan 15 16:16:34.444343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 782/1567] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:34 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:35.325471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:35.326084 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:35.332410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:35.332863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:35.333646 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:35.334082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:35.394649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:35.402939 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-becf6ff7-b5df-4ab1-9ba3-4a14d8d0c7d7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081126 Jan 15 16:16:35.403740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 786/1568] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:35.460900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:35.461677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:35.468852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:35.469376 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:35.470339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:35.470943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:35.534938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:35.542941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b3fdc8b1-49e6-478a-b8d1-3a6dcae00502 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1329 microversion: 2.1 time: 0.085674 Jan 15 16:16:35.543521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 783/1569] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:35 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1329 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:36.423407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:36.423953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:36.432635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:36.433351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:36.434358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:36.435134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:36.508048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:36.519962 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-58dc5a47-ff58-4c28-a261-b31312b68f1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.102501 Jan 15 16:16:36.521626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 787/1570] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:36.561177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:36.563802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:36.570781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:36.571467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:36.572592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:36.573338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:36.725939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:36.733416 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d5725b18-f3e6-4eaf-a2d1-66352c89f239 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.175857 Jan 15 16:16:36.743767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 784/1571] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:36 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:37.537125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:37.538518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:37.545006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:37.545760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:37.546876 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:37.547562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:37.614169 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:37.622909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ee8a75b5-dc7d-4f90-aa96-4791297ae228 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.089540 Jan 15 16:16:37.623583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 788/1572] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:37.752084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:37.752796 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:37.759081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:37.759748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:37.760566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:37.761002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:37.911505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:37.919057 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8576dc75-5a31-4ff4-8141-14c664277200 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.171941 Jan 15 16:16:37.928825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 785/1573] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:37 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:38.641855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:38.642502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:38.649963 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:38.650658 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:38.651663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:38.652107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:38.713477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:38.721977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-da368212-bf12-42d6-847d-cd330dd707a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083879 Jan 15 16:16:38.728304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 789/1574] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:38.941008 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:38.941008 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:38.943615 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:38.944070 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:38.944908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:38.945348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:39.081097 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:39.089092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fa973d98-cd31-4e3f-bcb2-962d19d90f7e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.156680 Jan 15 16:16:39.089991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 786/1575] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:38 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:39.739037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:39.739668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:39.746480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:39.746941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:39.747747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:39.748213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:39.811299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:39.819776 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-41d4c57a-1e08-4d29-891d-430ff592a4b0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.084616 Jan 15 16:16:39.820380 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 790/1576] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:40.106860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:40.107485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:40.114528 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:40.114978 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:40.115765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:40.116220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:40.259055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:40.266862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-23bfd0aa-2adf-4435-ad43-8116cd292de1 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.163599 Jan 15 16:16:40.267439 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 787/1577] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:40 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:40.837544 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:40.838462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:40.847533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:40.848110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:40.849005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:40.849510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:40.912961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:40.922260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5df72715-8440-4827-8265-ff5df35854d5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.088162 Jan 15 16:16:40.922852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 791/1578] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:41.284185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:41.284840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:41.291216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:41.291752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:41.292581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:41.293027 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:41.429963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:41.438743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-17fd9d04-12c7-46da-8453-fe7bcbb27cf2 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.158685 Jan 15 16:16:41.439357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 788/1579] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:41 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:41.941212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:41.941820 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:41.948147 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:41.948656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:41.949418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:41.949855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:42.134075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:42.134075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2fb56d9c-d036-4ff7-b175-e172f082fe21 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.111772 Jan 15 16:16:42.134075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 792/1580] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:42.456265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:42.457001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:42.463365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:42.463821 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:42.464641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:42.465086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:42.600829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:42.608535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9bbca46f-1157-4110-ad3a-25bc2de1a81a tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.156311 Jan 15 16:16:42.609402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 789/1581] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:42 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:43.065879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:43.066498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:43.073146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:43.073599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:43.074391 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:43.074830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:43.137687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:43.146675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e309b4c6-4775-46c8-b2e4-d7afcbc9f139 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.084442 Jan 15 16:16:43.147715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 793/1582] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:43.625832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:43.627112 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:43.633388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:43.633839 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:43.634619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:43.635073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:43.798009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:43.805752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f23c156f-79e4-402a-8b85-3bd304ccfc6b tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.184236 Jan 15 16:16:43.806345 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 790/1583] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:43 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:44.163891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:44.164633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:44.171344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:44.171814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:44.172613 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:44.173051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:44.232593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:44.241150 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3e8b163f-f2b1-4497-9e57-9b41aef804d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080935 Jan 15 16:16:44.253230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 794/1584] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:44.822463 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:44.823074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:44.830131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:44.830578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:44.831354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:44.831786 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:44.959349 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:44.966468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2ee7d212-8d27-46d2-9e1f-fad046913c47 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.147619 Jan 15 16:16:44.967032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 791/1585] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:44 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:45.267576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:45.268218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:45.274536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:45.274990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:45.275776 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:45.276249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:45.333776 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:45.341310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-00e0102c-befd-4474-9b0d-cb84aa421d0b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078002 Jan 15 16:16:45.341877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 795/1586] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:45.982937 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:45.983623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:45.990101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:45.990554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:45.991334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:45.991770 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:46.121644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:46.129467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8c28d347-64c1-4177-945c-aec27b523a3c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.150147 Jan 15 16:16:46.130029 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 792/1587] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:45 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:46.357571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:46.358118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:46.364931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:46.365388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:46.366170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:46.366610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:46.425308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:46.433057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-286eea26-22ab-479d-9d6d-9a65df7244ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079177 Jan 15 16:16:46.433631 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 796/1588] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:47.145974 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:47.146568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:47.152807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:47.153256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:47.154026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:47.154461 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:47.281149 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:47.288208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c8fc83ff-e6a9-45aa-9f1a-b0b9022180f0 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.145982 Jan 15 16:16:47.288825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 793/1589] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:47 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:47.450238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:47.451066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:47.457751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:47.458197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:47.458970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:47.459405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:47.521475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:47.529201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5f00adc9-55d1-4b0d-a79b-e1c97b177bdb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082629 Jan 15 16:16:47.529757 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 797/1590] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:48.305131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:48.305676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:48.312254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:48.312753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:48.313525 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:48.313959 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:48.438807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:48.445960 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3e69ec3a-50de-4a89-b4ce-4a10aab0fc12 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.144573 Jan 15 16:16:48.446528 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 794/1591] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:48 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:48.545391 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:48.546211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:48.552498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:48.552950 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:48.553764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:48.554199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:48.619791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:48.627904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6fbd6ebc-d273-4cb9-ae28-187cf9a4e3c2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.086087 Jan 15 16:16:48.628500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 798/1592] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:49.462963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:49.463576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:49.470339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:49.470783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:49.471563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:49.472003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:49.606281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:49.614157 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4c5217bb-119d-4782-8711-fc9a3751fc72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.154802 Jan 15 16:16:49.614733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 795/1593] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:49 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:49.644825 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:49.646021 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:49.652314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:49.652768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:49.653551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:49.653984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:49.713960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:49.722498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-60493fee-019d-4dfe-a349-1eb49d296d2e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081335 Jan 15 16:16:49.723281 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 799/1594] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:50.245857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-6fd507ca-5f95-465b-b912-d31dce3ad836 req-346a4e5f-74e1-420e-9278-86ded3d777f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "772ca06d-ce93-4b4d-a197-3fddb2b0cab0", "tag": "7639dbed-a145-4c3d-80b2-e7fb6c25688b"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:16:50.247462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:16:50.247462 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:16:50.255023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-6fd507ca-5f95-465b-b912-d31dce3ad836 req-346a4e5f-74e1-420e-9278-86ded3d777f2 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:50.255897 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-6fd507ca-5f95-465b-b912-d31dce3ad836 req-346a4e5f-74e1-420e-9278-86ded3d777f2 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:50.267484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-6fd507ca-5f95-465b-b912-d31dce3ad836 req-346a4e5f-74e1-420e-9278-86ded3d777f2 service nova] Creating event network-changed:7639dbed-a145-4c3d-80b2-e7fb6c25688b for instance 772ca06d-ce93-4b4d-a197-3fddb2b0cab0 on hv-cinder-82481 Jan 15 16:16:50.272725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-6fd507ca-5f95-465b-b912-d31dce3ad836 req-346a4e5f-74e1-420e-9278-86ded3d777f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030697 Jan 15 16:16:50.273406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 796/1595] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:16:50.630765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:50.631405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:50.637263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:50.637720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:50.638506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:50.638947 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:50.740755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:50.741374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:50.747650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:50.748209 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:50.750137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:50.750709 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:50.770775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:50.778407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f26c383d-6713-40e2-99df-6dbfd9de2b10 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.151257 Jan 15 16:16:50.779340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 800/1596] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:50 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:50.817786 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:50.825487 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d454784b-d925-4977-a45a-14eb9fd3266d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.089608 Jan 15 16:16:50.826053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 797/1597] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:51.794957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:51.795567 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:51.802682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:51.803123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:51.803894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:51.804381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:51.842413 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:51.844308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:51.850675 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:51.851165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:51.851979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:51.852433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:51.921470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:51.929476 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3372d8a1-3e4c-4c92-a690-379b0574f3f4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.090654 Jan 15 16:16:51.930045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 798/1598] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:51.955818 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:51.962960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e16c57ca-65b5-477d-9d9c-d8719122e63e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.171616 Jan 15 16:16:51.963522 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 801/1599] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:51 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:52.946390 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:52.947025 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:52.953338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:52.953790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:52.954560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:52.954995 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:52.980986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:52.981607 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:52.988611 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:52.989067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:52.989857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:52.990302 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:53.014453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:53.022221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-579a7af4-6927-4026-a071-f4a963539e69 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079537 Jan 15 16:16:53.022797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 799/1600] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:53.116592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:53.123697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-13abffd0-9d2e-42b0-939e-4ef8c4dcb97d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.146314 Jan 15 16:16:53.124734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 802/1601] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:52 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:54.038689 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:54.039303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:54.046237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:54.046819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:54.047600 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:54.048041 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:54.107875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:54.116354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6643b547-11c1-417d-8912-33228209592d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081361 Jan 15 16:16:54.116921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 800/1602] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:54.141313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:54.141932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:54.148575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:54.149033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:54.149817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:54.150257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:54.277739 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:54.285923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-009368df-23ec-4f77-807c-90d50ff89a2d tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.148177 Jan 15 16:16:54.286663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 803/1603] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:54 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:54.521907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e3edc194-a2a0-4f69-9f70-4836e9a190fe tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] Calling method '.version_select at 0x7f21680aaca0>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:54.598260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e3edc194-a2a0-4f69-9f70-4836e9a190fe tempest-TestVolumeBootPattern-522182994 tempest-TestVolumeBootPattern-522182994-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1937322022" status: 202 len: 0 microversion: 2.1 time: 0.079941 Jan 15 16:16:54.598856 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 801/1604] 10.222.0.36 () {58 vars in 1262 bytes} [Sat Jan 15 16:16:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1937322022 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:16:55.136313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:55.136933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:55.142690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:55.143382 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:55.144079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:55.144549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:55.212003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:55.222324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5aacf118-d55c-4276-9c93-0adf031c394b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.089579 Jan 15 16:16:55.223050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 804/1605] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:55.303389 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:55.304166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:55.309973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:55.310421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:55.311199 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:55.311641 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:55.446976 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:55.454754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7aeef225-ddf6-4e03-824a-17eec13eab72 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.155570 Jan 15 16:16:55.455333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 802/1606] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:55 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:56.239546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:56.240121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:56.246266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:56.246715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:56.247485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:56.247916 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:56.308635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:56.317166 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ef4cd0f-5e95-4e86-b41d-1ac36b619d67 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081368 Jan 15 16:16:56.317735 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 805/1607] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:56.471473 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:56.472080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:56.479117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:56.479773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:56.480947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:56.481521 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:56.688473 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:56.695572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cfc5112d-a5c9-4d62-b467-4d839b39c27e tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.228583 Jan 15 16:16:56.696153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 803/1608] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:56 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:57.335472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:57.336360 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:57.343950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:57.344776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:57.345807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:57.346446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:57.421313 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-2b4b5380-3def-499d-b173-599833d46c16 req-f493308d-ea08-4c1d-b80b-9a58acec47c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772ca06d-ce93-4b4d-a197-3fddb2b0cab0", "name": "network-vif-plugged", "status": "completed", "tag": "7639dbed-a145-4c3d-80b2-e7fb6c25688b"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:16:57.423524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:16:57.423524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:16:57.434387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:57.434513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-2b4b5380-3def-499d-b173-599833d46c16 req-f493308d-ea08-4c1d-b80b-9a58acec47c5 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:57.434513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-2b4b5380-3def-499d-b173-599833d46c16 req-f493308d-ea08-4c1d-b80b-9a58acec47c5 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:57.439935 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-36d385cc-c9df-45e0-8483-275e7ef8c997 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.108412 Jan 15 16:16:57.440657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 804/1609] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:57.445258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-2b4b5380-3def-499d-b173-599833d46c16 req-f493308d-ea08-4c1d-b80b-9a58acec47c5 service nova] Creating event network-vif-plugged:7639dbed-a145-4c3d-80b2-e7fb6c25688b for instance 772ca06d-ce93-4b4d-a197-3fddb2b0cab0 on hv-cinder-82481 Jan 15 16:16:57.451661 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-2b4b5380-3def-499d-b173-599833d46c16 req-f493308d-ea08-4c1d-b80b-9a58acec47c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180086 Jan 15 16:16:57.452531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 806/1610] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:16:57.712924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:57.713588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:57.720779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:57.721236 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:57.722092 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:57.722633 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:57.995773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:58.004357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8a4e6861-82bf-4c39-8420-40f630e454b3 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.295341 Jan 15 16:16:58.007340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 805/1611] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:57 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:58.458992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:58.459806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:58.465857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:58.466338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:58.467128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:58.467650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:58.566937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:58.580215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1f4a5158-13c6-44d9-b20b-92f88b1451f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.122067 Jan 15 16:16:58.580215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 807/1612] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:16:59.021384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:59.022009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:59.030274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:59.046125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:59.047129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:59.047520 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:59.185101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:59.192924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6161b710-5096-44e3-9a1e-cf8e1fccbb1c tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1359 microversion: 2.1 time: 0.175316 Jan 15 16:16:59.193516 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 806/1613] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:59 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:16:59.593595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:16:59.594336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:16:59.600807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:59.601260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:59.602042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:16:59.602477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:16:59.665563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:16:59.674126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-30623cb9-05fa-4a7a-9d2c-7c642e47b4eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.084823 Jan 15 16:16:59.674826 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 808/1614] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:16:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:00.209872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:00.210514 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:00.216766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.217273 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.218573 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.219006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.346311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:00.353634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-76aa51f6-5a3b-4315-9ffa-ddbc3aefb2ff tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1549 microversion: 2.1 time: 0.147442 Jan 15 16:17:00.354200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 807/1615] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:00 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:00.370890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:00.371512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:00.379246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.379864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.381025 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.381641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.519800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:00.528288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b08058cb-3175-499a-89ab-982760f693ce tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1549 microversion: 2.1 time: 0.160989 Jan 15 16:17:00.529103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 809/1616] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:00 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:00.545125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:00.549937 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:17:00.549937 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:17:00.550874 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:00.551619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Searching by: {'deleted': False, 'project_id': 'c854f3c8a7a343dd81194043bbdec268'} {{(pid=123221) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 16:17:00.558118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.558757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.559706 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.560162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.652979 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.multi_cell_list [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123221) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 16:17:00.694945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:00.696224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:00.707551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.708601 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.709706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.710389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.754231 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-38d7d51f-24a3-4cbd-8370-8154753e42b9 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212624 Jan 15 16:17:00.754812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 808/1617] 10.222.0.36 () {58 vars in 1124 bytes} [Sat Jan 15 16:17:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:17:00.764925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:00.765777 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:00.772103 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.772585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.773371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:00.774429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:00.776403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:00.786051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ab19b95-db1c-48e9-8482-36fa952d41e2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.097775 Jan 15 16:17:00.786634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 810/1618] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:00.911595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:00.919069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e95c3da3-a11c-49be-b5b0-a5819e572aed tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1549 microversion: 2.1 time: 0.157990 Jan 15 16:17:00.924559 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 809/1619] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:00 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:17:01.802749 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:01.803358 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:01.810584 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:01.817513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:01.818452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:01.819129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:01.927392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:01.935288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-54c1bc6f-7a86-475c-ac98-1a64dbad3bfd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.136413 Jan 15 16:17:01.936399 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 811/1620] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:02.954534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:02.955147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:02.961686 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:02.962146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:02.962968 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:02.963409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:03.024239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:03.032101 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0137535f-4bed-48b3-ab86-a4563f64bef9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082098 Jan 15 16:17:03.032697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 810/1621] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:04.049308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:04.049931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:04.056405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:04.056856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:04.057656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:04.058275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:04.118388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:04.126703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bd06f5c6-0bbb-43e6-ac10-72afba614599 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081631 Jan 15 16:17:04.127206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 812/1622] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:05.144841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:05.145447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:05.152598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:05.153048 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:05.153831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:05.154271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:05.212071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:05.219667 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-87609efb-2854-4dab-bfe4-8b185e81db98 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079746 Jan 15 16:17:05.220261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 811/1623] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:06.235779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:06.236422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:06.243031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:06.243489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:06.244320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:06.244767 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:06.305323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:06.313512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-414dc3c2-3f60-4612-b05a-4914442f46c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081868 Jan 15 16:17:06.314077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 813/1624] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:07.330046 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:07.330582 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:07.336921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:07.337375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:07.338152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:07.338591 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:07.396588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:07.404193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f953d86b-44ef-4931-9aee-644ccacc692e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077887 Jan 15 16:17:07.404754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 812/1625] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:08.421630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:08.422243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:08.428427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:08.428869 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:08.429636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:08.430065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:08.490110 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:08.497880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-240301db-b615-4e79-a255-a48df1a04a7c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080026 Jan 15 16:17:08.498445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 814/1626] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:09.514681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:09.515631 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:09.521991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:09.522438 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:09.523207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:09.523640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:09.587096 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:09.595270 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-27bd1fb4-199d-4bf5-b597-e98f4b2d39fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.084174 Jan 15 16:17:09.596062 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 813/1627] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:10.612762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:10.613369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:10.619535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:10.619981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:10.620780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:10.621216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:10.679330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:10.687546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d0a96d75-6412-47c4-8e30-83182453a82f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078442 Jan 15 16:17:10.688105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 815/1628] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:11.704512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:11.705146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:11.711459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:11.711909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:11.712725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:11.713335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:11.779289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:11.787533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e4602867-5424-417c-8c9e-baff6b295512 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.087292 Jan 15 16:17:11.788104 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 814/1629] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:12.803946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:12.804625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:12.810927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:12.811380 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:12.812304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:12.812745 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:12.870488 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:12.878427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4ec3a400-9501-4ede-86ac-241882b7c7ee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078170 Jan 15 16:17:12.878989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 816/1630] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:13.893950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:13.894568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:13.901063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:13.901520 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:13.902311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:13.902751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:13.967126 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:13.975595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f122a407-7bb4-46eb-95fc-643843e02d1a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085301 Jan 15 16:17:13.976166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 815/1631] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:14.992210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:14.992842 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:14.999336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:14.999883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:15.000678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:15.001117 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:15.062428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:15.070018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0f87fb4c-a5b3-4250-a2ab-a829ccae4587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081529 Jan 15 16:17:15.070577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 817/1632] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:16.086867 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:16.087483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:16.093782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:16.094230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:16.095012 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:16.095453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:16.153326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:16.161297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8ce2c905-f045-43bf-8a9d-a86f4ef4bcf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078059 Jan 15 16:17:16.161863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 816/1633] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:17.177821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:17.178436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:17.184684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:17.185124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:17.185892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:17.186335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:17.244983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:17.252871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e75b5642-7271-4333-a877-4228a1df37a8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078653 Jan 15 16:17:17.253434 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 818/1634] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:18.269817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:18.270470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:18.276767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:18.277219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:18.277997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:18.278436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:18.337171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:18.344967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-72fa8f88-991f-4f1b-89e8-cf865b7ad33a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078777 Jan 15 16:17:18.345534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 817/1635] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:19.361599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:19.362162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:19.368450 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:19.368900 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:19.369676 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:19.370114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:19.428409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:19.435989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d670fc92-e8cb-4c69-aea5-4e02de82e832 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078333 Jan 15 16:17:19.437236 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 819/1636] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:20.453554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:20.454169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:20.460550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:20.461005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:20.461790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:20.462228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:20.521055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:20.528891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-266e1a24-8522-4223-a20e-7ca2941806ac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079574 Jan 15 16:17:20.529446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 818/1637] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:17:21.546437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:21.547238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:21.553662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:21.554118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:21.554901 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:21.555344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:21.615983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:21.624061 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2d48ac06-a01a-49a9-a784-3f31736a0d76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081838 Jan 15 16:17:21.624673 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 820/1638] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:22.640676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:22.641496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:22.647717 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:22.648188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:22.648963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:22.649397 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:22.707963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:22.715742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3f96f2be-bc6a-45fd-9596-a9d213acc6a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079551 Jan 15 16:17:22.716340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 819/1639] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:23.732847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:23.733847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:23.740823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:23.741268 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:23.742046 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:23.742478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:23.805132 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:23.813432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e3e36d31-561c-4c35-9ac6-231dc5c35e2f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.084204 Jan 15 16:17:23.813995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 821/1640] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:24.829366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:24.829970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:24.836165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:24.836624 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:24.837393 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:24.837826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:24.895713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:24.903288 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ef9447ad-a184-4ad8-833a-0c0f5eabf2ab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078065 Jan 15 16:17:24.903846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 820/1641] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:25.920006 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:25.920790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:25.927278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:25.927722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:25.928531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:25.928968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:25.987264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:25.994800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d2a722d3-74c0-4135-a9c5-49ca7f456c10 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078460 Jan 15 16:17:25.995359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 822/1642] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:27.012806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:27.013452 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:27.020282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:27.020738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:27.021524 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:27.021952 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:27.083812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:27.091507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bd3d3f95-7b79-4ed3-bcc0-5bfbd22d70e8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082458 Jan 15 16:17:27.092121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 821/1643] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:28.108559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:28.109351 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:28.115322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:28.115764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:28.116564 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:28.116995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:28.178793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:28.187005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9ca05047-ae2f-41b2-a3ed-86f712ed1fd4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081517 Jan 15 16:17:28.187609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 823/1644] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:29.203725 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:29.204409 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:29.210621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:29.211067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:29.211838 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:29.212308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:29.270202 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:29.277834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e251bbcd-9aad-4c77-a1ee-42eeb7b0e975 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078309 Jan 15 16:17:29.278401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 822/1645] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:30.294691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:30.295845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:30.302363 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:30.303018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:30.303802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:30.304271 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:30.363892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:30.372177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d1668318-2ac5-431d-b27b-3ddb6d9c3839 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081208 Jan 15 16:17:30.372879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 824/1646] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:31.389179 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:31.389887 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:31.396082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:31.396555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:31.397331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:31.397763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:31.455852 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:31.463526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e7e471bd-6d1c-487c-b729-cd2aded32861 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078122 Jan 15 16:17:31.464090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 823/1647] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:32.481211 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:32.481860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:32.488403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:32.488848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:32.489620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:32.490055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:32.548981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:32.556559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f9e46ce1-f43c-4eeb-b0cd-484938eedfa3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079103 Jan 15 16:17:32.557118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 825/1648] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:33.573254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:33.573860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:33.579997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:33.580479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:33.581253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:33.581688 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:33.641490 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:33.649310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-68098de3-eaea-44f7-adcf-bdda54ee1e01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079831 Jan 15 16:17:33.649861 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 824/1649] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:34.667466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:34.668098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:34.674602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:34.675053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:34.675834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:34.676300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:34.738491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:34.746484 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-90b30186-23ed-4fb4-a671-68e1465f0d1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083285 Jan 15 16:17:34.747060 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 826/1650] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:35.763256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:35.763900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:35.770654 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:35.771103 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:35.771870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:35.772333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:35.829831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:35.837520 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7a63c8e6-08df-403f-a7bf-fd6323fe3c37 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077857 Jan 15 16:17:35.838090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 825/1651] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:36.854004 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:36.854621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:36.861630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:36.862086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:36.862868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:36.863310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:36.922377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:36.930013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c7df2232-bc1d-4982-a50a-f6d3391cbb94 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079701 Jan 15 16:17:36.930582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 827/1652] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:37.946552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:37.947062 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:37.954330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:37.954777 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:37.955558 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:37.955991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:38.015882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:38.023977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-45ccfc0c-8baa-47f5-94d6-0ed5db26d49e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081124 Jan 15 16:17:38.024585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 826/1653] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:39.040681 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:39.041299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:39.047686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:39.050100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:39.050100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:39.050100 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:39.109342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:39.117042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e2bf1624-74b4-4fc4-8473-f6201a83afc3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080100 Jan 15 16:17:39.117607 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 828/1654] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:17:40.133738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:40.134356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:40.140699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:40.141150 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:40.141931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:40.142378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:40.200388 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:40.208096 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f175ad7b-4c3d-460d-b0c7-999810970149 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078046 Jan 15 16:17:40.208887 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 827/1655] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:41.225035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:41.225644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:41.231824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:41.232300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:41.233964 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:41.234416 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:41.293996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:41.302386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ee2ac88c-31d6-4f64-aa0d-f7cac67306e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080997 Jan 15 16:17:41.302951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 829/1656] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:42.319601 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:42.320215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:42.327018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:42.327565 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:42.328387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:42.328832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:42.386623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:42.394975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-610a169e-4065-4c97-b589-17454bb5ec00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079062 Jan 15 16:17:42.395538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 828/1657] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:43.412412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:43.413030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:43.419181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:43.419631 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:43.421210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:43.421648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:43.479437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:43.487537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-995b3367-dcca-410d-af1d-0409ee26f1dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079877 Jan 15 16:17:43.488111 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 830/1658] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:44.504877 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:44.505496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:44.511877 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:44.512373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:44.513213 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:44.513658 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:44.572219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:44.579958 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ee14c1d3-a7cb-409e-92c9-d608f3443584 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078803 Jan 15 16:17:44.580552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 829/1659] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:45.596889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:45.597506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:45.603733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:45.604204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:45.604983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:45.605414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:45.664763 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:45.675093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2a69827c-648b-49ac-ae45-0e1356a3baa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081794 Jan 15 16:17:45.675660 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 831/1660] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:46.691711 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:46.692361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:46.698523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:46.698977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:46.699757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:46.700218 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:46.760673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:46.768999 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c4ca905a-5f08-4048-a513-3ffa49cb87cf tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081078 Jan 15 16:17:46.769569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 830/1661] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:47.785515 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:47.786123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:47.792458 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:47.792902 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:47.793674 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:47.794105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:47.854598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:47.863798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4eba1fab-809d-41cd-bdd2-4599c80f0492 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081929 Jan 15 16:17:47.864393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 832/1662] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:48.880151 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:48.880849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:48.887261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:48.887742 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:48.888596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:48.889108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:48.948556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:48.956499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bb084025-36d3-4771-a849-699285a8c5d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080022 Jan 15 16:17:48.958546 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 831/1663] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:49.974115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:49.974633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:49.980955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:49.981410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:49.982194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:49.983255 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:50.041088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:50.049618 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0201c9d7-9e4a-443f-be5f-00c11ff23387 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079296 Jan 15 16:17:50.050196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 833/1664] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:51.066543 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:51.067157 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:51.073422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:51.073875 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:51.074651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:51.075090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:51.133310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:51.141396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-97f3885b-7351-47f5-bbc6-6c6c5aa1305b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078557 Jan 15 16:17:51.141955 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 832/1665] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:52.157744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:52.158393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:52.164753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:52.165205 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:52.165984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:52.166422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:52.225451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:52.233155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ade7df79-9136-4177-9bb7-2db1eb5b4035 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079252 Jan 15 16:17:52.233712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 834/1666] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:53.250056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:53.250673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:53.256838 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:53.257286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:53.258058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:53.258490 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:53.316747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:53.324431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-362d9f0c-05df-427e-87e8-c2e4969307d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078550 Jan 15 16:17:53.325004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 833/1667] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:54.341003 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:54.342073 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:54.348487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:54.348930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:54.349699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:54.350163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:54.414451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:54.423035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1ca9d1ff-5fd3-4213-b88f-3578cb421c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085813 Jan 15 16:17:54.423597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 835/1668] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:55.439298 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:55.439933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:55.446204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:55.446652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:55.447415 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:55.447847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:55.506966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:55.516163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-105de6f1-b619-436d-8079-ca7ba9829c88 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080682 Jan 15 16:17:55.516728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 834/1669] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:56.532851 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:56.533485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:56.539839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:56.540331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:56.541115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:56.541555 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:56.602691 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:56.611073 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-02295a0b-0a63-48f3-bb6e-409a63cff701 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082132 Jan 15 16:17:56.611638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 836/1670] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:57.628042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:57.628693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:57.634900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:57.635348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:57.636121 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:57.636585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:57.695317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:57.703559 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-718cd612-5234-4c9c-a1a1-89e2202436c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079186 Jan 15 16:17:57.704126 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 835/1671] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:17:58.720183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:58.720777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:58.727196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:58.727640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:58.728446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:58.728875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:58.787024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:58.794657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-75ca0bd7-2625-47a7-96c7-a3e8e5181c49 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078215 Jan 15 16:17:58.795852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 837/1672] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:17:59.811688 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:17:59.812366 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:17:59.818625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:59.819075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:59.819855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:17:59.820320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:17:59.878246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:17:59.885782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-34b89125-ebcb-48b8-bbba-e2e189daacf8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077741 Jan 15 16:17:59.886346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 836/1673] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:17:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:00.903851 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:00.906103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:00.911120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:00.911572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:00.912392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:00.912828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:00.973954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:00.981609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5605e8dd-c4fa-4b0f-8f44-8ce85a154dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081427 Jan 15 16:18:00.982179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 838/1674] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:01.003760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:01.004303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:01.010554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:01.011004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:01.011782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:01.012271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:01.035977 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:18:01.320780 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-380df31b-817e-4bcf-b3f4-81f47751f646 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "DELETE /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 204 len: 0 microversion: 2.1 time: 0.320365 Jan 15 16:18:01.321373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 837/1675] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:18:00 2022] DELETE /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:18:01.329471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:01.330124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:01.336294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:01.336748 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:01.337530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:01.337970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:01.467372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:01.474797 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0574e0ca-6738-41ce-a380-26f6ba013879 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1555 microversion: 2.1 time: 0.149155 Jan 15 16:18:01.475369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 839/1676] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:01 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:01.999822 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:02.000467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:02.006501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:02.007083 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:02.007790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:02.008264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:02.069549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:02.078081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3b280bcb-93c5-48ec-9e38-a6b23104e70e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083141 Jan 15 16:18:02.078671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 838/1677] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:02.491448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:02.492096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:02.498840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:02.499288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:02.500070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:02.500527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:02.653085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:02.660701 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7d47accd-5ee5-4292-aab7-e84ff30ead97 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1555 microversion: 2.1 time: 0.173132 Jan 15 16:18:02.661271 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 840/1678] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:02 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:03.094578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:03.095200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:03.101507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:03.101959 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:03.102749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:03.103186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:03.163112 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:03.171228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d6fdd79e-ecea-4316-b638-4a9bb430987d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080361 Jan 15 16:18:03.171793 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 839/1679] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:03.676909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:03.677614 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:03.683334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:03.689650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:03.689650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:03.689650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:03.747566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbb31e0372546b480ecd798079d6b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c854f3c8a7a343dd81194043bbdec268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:03.755348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-818ec6f2-2e67-4e4d-b4d3-650db5bf2c64 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 200 len: 1513 microversion: 2.1 time: 0.082202 Jan 15 16:18:03.755915 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 840/1680] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:03 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 1513 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:18:03.817343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-df77b7c1-2607-490b-bce7-e954397a438e req-4c91a6a2-5cb8-4810-9847-e170e2cf93c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772ca06d-ce93-4b4d-a197-3fddb2b0cab0", "name": "network-vif-deleted", "tag": "7639dbed-a145-4c3d-80b2-e7fb6c25688b"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:18:03.818930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:18:03.818930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:18:03.825870 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-df77b7c1-2607-490b-bce7-e954397a438e req-4c91a6a2-5cb8-4810-9847-e170e2cf93c1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:03.826344 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-df77b7c1-2607-490b-bce7-e954397a438e req-4c91a6a2-5cb8-4810-9847-e170e2cf93c1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:03.837345 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-df77b7c1-2607-490b-bce7-e954397a438e req-4c91a6a2-5cb8-4810-9847-e170e2cf93c1 service nova] Creating event network-vif-deleted:7639dbed-a145-4c3d-80b2-e7fb6c25688b for instance 772ca06d-ce93-4b4d-a197-3fddb2b0cab0 on hv-cinder-82481 Jan 15 16:18:03.844655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-df77b7c1-2607-490b-bce7-e954397a438e req-4c91a6a2-5cb8-4810-9847-e170e2cf93c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207531 Jan 15 16:18:03.844655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 841/1681] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:18:04.188797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:04.189405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:04.195471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:04.195945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:04.196759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:04.197193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:04.259252 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:04.267197 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-61be5aee-5dcc-4c7d-a6aa-2b54f827bab8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082399 Jan 15 16:18:04.267760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 841/1682] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:04.772464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:04.773162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] [instance: 772ca06d-ce93-4b4d-a197-3fddb2b0cab0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:04.779927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:04.780571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:04.781395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:04.781826 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:04.794438 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] HTTP exception thrown: Instance 772ca06d-ce93-4b4d-a197-3fddb2b0cab0 could not be found. Jan 15 16:18:04.795334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Returning 404 to user: Instance 772ca06d-ce93-4b4d-a197-3fddb2b0cab0 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:18:04.796231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-64209fdb-88b7-4cce-ae3d-c87f63a2ad88 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0" status: 404 len: 111 microversion: 2.1 time: 0.028268 Jan 15 16:18:04.796749 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 842/1683] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:04 2022] GET /compute/v2.1/servers/772ca06d-ce93-4b4d-a197-3fddb2b0cab0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:18:04.804596 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9ed0d9eb-ac46-4de6-80ed-16ffd62dc343 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] Calling method '.version_select at 0x7f2163672700>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:04.887527 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9ed0d9eb-ac46-4de6-80ed-16ffd62dc343 tempest-TestMinimumBasicScenario-196446905 tempest-TestMinimumBasicScenario-196446905-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1431965039" status: 202 len: 0 microversion: 2.1 time: 0.086445 Jan 15 16:18:04.888110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 842/1684] 10.222.0.36 () {58 vars in 1271 bytes} [Sat Jan 15 16:18:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1431965039 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 16:18:05.283924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:05.284644 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:05.290630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:05.291075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:05.291843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:05.292314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:05.352506 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:05.360772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-99f5c399-059e-4cc0-b19e-4f800309deab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080477 Jan 15 16:18:05.361336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 843/1685] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:06.377949 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:06.378510 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:06.385024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:06.385481 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:06.386264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:06.386703 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:06.444869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:06.453055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0a62c157-5c97-4490-be19-d8254875fae6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079369 Jan 15 16:18:06.453888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 843/1686] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:07.470032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:07.470626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:07.481172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:07.481637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:07.483205 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:07.483604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:07.568612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:07.580558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c90eed15-69b3-4f32-b1e6-928255c5f2cb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.114327 Jan 15 16:18:07.584653 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 844/1687] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:08.598502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:08.599858 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:08.608380 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:08.612303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:08.613220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:08.613681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:08.713338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:08.722437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-80cb9878-5b41-4071-aaa0-c4eb21226593 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.127725 Jan 15 16:18:08.723190 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 844/1688] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:18:09.741744 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:09.743272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:09.751503 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:09.751957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:09.752802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:09.753243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:09.825755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:09.831155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5727d1dd-6417-47f7-9412-4b92a8d8a5a1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.094673 Jan 15 16:18:09.831918 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 845/1689] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:10.847919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:10.848566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:10.855100 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:10.855559 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:10.856381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:10.856825 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:10.924534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:10.932666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-db07eefc-79f7-48a4-99ac-6d601e9651fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.088381 Jan 15 16:18:10.933244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 845/1690] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:11.951743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:11.952982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:11.959421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:11.960263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:11.961224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:11.961873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:12.042481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:12.051124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7ced3401-9645-4df2-9528-2297176931fe tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.105026 Jan 15 16:18:12.054032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 846/1691] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:13.068568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:13.069193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:13.075424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:13.075889 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:13.076734 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:13.077167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:13.182311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:13.191079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-73176ad3-221c-4aa2-9b51-b2774955871e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.126129 Jan 15 16:18:13.191766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 846/1692] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:14.206685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:14.207387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:14.213652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:14.214092 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:14.214864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:14.215293 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:14.284305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:14.291990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8ed60cc1-498b-4a04-aaa5-34cc45043b12 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.088915 Jan 15 16:18:14.292514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 847/1693] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:15.309946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:15.309946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:15.316764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:15.317220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:15.318006 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:15.318486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:15.379135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:15.386850 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d09026bc-6940-4978-b004-35f96cd661e1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081501 Jan 15 16:18:15.387413 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 847/1694] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:16.403062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:16.404295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:16.410602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:16.411054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:16.411830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:16.412300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:16.471445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:16.479075 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-de07cd38-c936-44c0-a7ae-32da35be5751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079649 Jan 15 16:18:16.481088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 848/1695] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:17.495665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:17.496300 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:17.503817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:17.504313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:17.505093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:17.505529 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:17.567533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:17.575513 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6fdecd94-57da-4486-a6ba-f4b6cfd66a34 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083509 Jan 15 16:18:17.576219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 848/1696] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:17.697372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:18:17.697531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:18:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:18:18.593099 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:18.593625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:18.599856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:18.600352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:18.601134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:18.601569 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:18.660822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:18.669005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f3778c2c-1a02-473f-80e3-283836598405 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080301 Jan 15 16:18:18.670203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 849/1697] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:18:19.686293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:19.687619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:19.693115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:19.693564 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:19.694332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:19.694767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:19.753249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:19.760906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4b98a6ea-ffb4-4e26-a4f2-a89a5b3dd1d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078948 Jan 15 16:18:19.761471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 849/1698] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:20.776694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:20.777303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:20.783836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:20.784395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:20.785166 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:20.785599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:20.844180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:20.851843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e94ef523-15ec-48a4-89c9-60aa1f8033b7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078767 Jan 15 16:18:20.852445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 850/1699] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:22.080098 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:22.080738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:22.086532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:22.093110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:22.093110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:22.093110 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:22.147223 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:22.154961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ea6e489d-91fe-4d51-9384-7be63189358b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.290424 Jan 15 16:18:22.155541 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 850/1700] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:23.172527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:23.173141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:23.179327 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:23.179781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:23.180629 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:23.181066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:23.238603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:23.246243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-594492fb-b433-45d5-b703-f99bc1da5a24 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078171 Jan 15 16:18:23.248590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 851/1701] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:24.265500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:24.266160 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:24.272456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:24.272908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:24.273693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:24.274135 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:24.336776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:24.344815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a5159fef-feab-4890-9e46-3e69625d60c4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085218 Jan 15 16:18:24.345382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 851/1702] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:25.360805 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:25.361334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:25.367576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:25.368030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:25.368831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:25.369275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:25.427618 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:25.435853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8dde09ae-873b-4e16-9b63-9c4155dc0bca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079300 Jan 15 16:18:25.436449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 852/1703] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:26.464559 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:26.465169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:26.471458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:26.471903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:26.472710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:26.473140 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:26.532065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:26.539697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8cca896f-9885-4769-a8b7-6dc8e8b5f4db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078813 Jan 15 16:18:26.540272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 852/1704] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:27.555912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:27.556576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:27.563483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:27.563931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:27.564765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:27.565200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:27.624793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:27.632816 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4fdb930b-7970-4e09-a825-b656d52a0a86 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080555 Jan 15 16:18:27.633390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 853/1705] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:28.649250 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:28.649863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:28.656321 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:28.656776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:28.657549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:28.657980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:28.715776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:28.723377 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d4391cb9-4b64-4bf7-bc12-bf17b86c7a18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077746 Jan 15 16:18:28.723927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 853/1706] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:29.740403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:29.740957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:29.748109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:29.748606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:29.749389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:29.749832 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:29.808471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:29.817055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-186537ed-b8fd-4d76-bb3f-a2200cd77fae tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080417 Jan 15 16:18:29.817621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 854/1707] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:30.833943 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:30.834548 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:30.841464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:30.841922 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:30.842694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:30.843128 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:30.903007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:30.911111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f4505b02-4891-42f7-a199-5aeb5edc8197 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080796 Jan 15 16:18:30.911668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 854/1708] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:31.928323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:31.928868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:31.935491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:31.935941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:31.936752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:31.937197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:31.995245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:32.003968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-df433141-1ed0-4e23-a989-2de8bbdaf598 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079411 Jan 15 16:18:32.004841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 855/1709] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:18:33.020944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:33.021557 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:33.028212 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:33.028682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:33.029682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:33.030124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:33.088208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:33.095899 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cdfb18fb-5781-4264-b494-679ee5d58589 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078568 Jan 15 16:18:33.096453 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 855/1710] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:33.857319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:18:33.857796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:18:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:18:34.112875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:34.113493 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:34.119784 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:34.120276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:34.121051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:34.122353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:34.182245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:34.190441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-da886ffe-9dd2-4742-b4c1-bd65b49280fc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081217 Jan 15 16:18:34.190997 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 856/1711] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:35.206855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:35.207459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:35.213382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:35.213847 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:35.214587 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:35.215021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:35.273446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:35.281688 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-811a67bb-d462-4505-b8b4-92dfd2d377c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078476 Jan 15 16:18:35.282257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 856/1712] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:36.298848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:36.299369 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:36.305733 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:36.306185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:36.306962 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:36.307401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:36.365132 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:36.373129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8269abd1-1609-4750-9e3c-91580b5610c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078074 Jan 15 16:18:36.373693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 857/1713] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:37.389973 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:37.390589 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:37.396923 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:37.397378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:37.398162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:37.398606 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:37.459512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:37.467493 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-380edac2-c129-42fe-8aa6-2c299f0f2cf7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081631 Jan 15 16:18:37.468311 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 857/1714] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:38.484459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:38.489605 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:38.491520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:38.491970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:38.492785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:38.493228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:38.552595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:38.559633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-aa7b2886-c325-4a54-a3d6-1ec6153b9533 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078870 Jan 15 16:18:38.560214 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 858/1715] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:39.576677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:39.577302 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:39.583534 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:39.583992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:39.584816 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:39.585262 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:39.645961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:39.653769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f78cc329-08fa-461e-af76-67fef2a09a11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080980 Jan 15 16:18:39.654336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 858/1716] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:40.670193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:40.670806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:40.677137 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:40.677587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:40.678360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:40.678799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:40.737062 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:40.744762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9b90d4d7-30e3-4d9b-bce5-f1ce8fc65e9f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078238 Jan 15 16:18:40.745325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 859/1717] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:41.763431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:41.764047 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:41.770502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:41.770961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:41.771752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:41.772219 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:41.832129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:41.839896 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f68d6b69-3c7e-4cc6-9f7f-4b0c9f406650 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081004 Jan 15 16:18:41.841108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 859/1718] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:42.857321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:42.858120 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:42.864286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:42.864747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:42.865531 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:42.865977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:42.924263 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:42.931947 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-edc5b15e-0702-490b-811f-d99a9c349dac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078319 Jan 15 16:18:42.932558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 860/1719] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:43.948013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:43.948579 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:43.955581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:43.956026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:43.956849 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:43.957281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:44.018707 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:44.026319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ae47a584-706b-418e-afd3-4f29173c2652 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082014 Jan 15 16:18:44.026882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 860/1720] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:45.042577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:45.043195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:45.050112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:45.050562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:45.051341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:45.051777 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:45.109917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:45.117769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-acbfe02c-5152-46c5-86c1-ee0a0c2d0f1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078893 Jan 15 16:18:45.118324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 861/1721] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:46.134456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:46.135099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:46.142080 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:46.142536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:46.143335 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:46.143776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:46.208598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:46.216597 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9b9f0d9c-ab87-4134-a679-63053027be22 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085700 Jan 15 16:18:46.218114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 861/1722] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:47.233456 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:47.234063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:47.240319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:47.240756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:47.241623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:47.242059 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:47.300835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:47.308377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-da1fa94a-40b1-4ecf-9e6f-ef32cad17f60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078590 Jan 15 16:18:47.308933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 862/1723] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:48.325391 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:48.326468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:48.332831 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:48.333306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:48.334087 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:48.334526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:48.392344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:48.399975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b298f098-8451-4a14-8af2-c14159a13537 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078275 Jan 15 16:18:48.400634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 862/1724] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:49.416795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:49.417407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:49.424306 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:49.424755 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:49.425525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:49.425960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:49.483782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:49.491464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f35cb673-877d-465e-92b0-458104c0f7bb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078342 Jan 15 16:18:49.492020 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 863/1725] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:50.508224 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:50.508846 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:50.515665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:50.516200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:50.516993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:50.517437 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:50.578081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:50.585743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0571738e-2c5a-4bd4-ab83-f2cb31f956bc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081295 Jan 15 16:18:50.586301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 863/1726] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:51.602013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:51.602621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:51.608961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:51.609409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:51.610183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:51.610646 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:51.669628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:51.677280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a0d2a351-3807-4bb9-a635-77ea9d53b473 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078896 Jan 15 16:18:51.677845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 864/1727] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:52.695691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:52.696333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:52.704207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:52.704671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:52.705468 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:52.705909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:52.765139 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:52.772691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b0960c9c-b9f1-486d-a25d-0fbf14db10c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080598 Jan 15 16:18:52.773254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 864/1728] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:53.789693 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:53.790308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:53.796619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:53.797074 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:53.797853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:53.798289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:53.856785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:53.864483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-01e4155f-8dd0-4128-9d33-cccff7389459 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078445 Jan 15 16:18:53.865042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 865/1729] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:54.583174 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:54.583683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:54.589843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:54.590297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:54.591078 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:54.591684 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:54.605947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] HTTP exception thrown: Instance a62b0ad3-733e-4543-8395-a9ebb0de6702 could not be found. Jan 15 16:18:54.606700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Returning 404 to user: Instance a62b0ad3-733e-4543-8395-a9ebb0de6702 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:18:54.608074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-086f3cd1-6e99-4b1f-8fe7-6535ecf02fb4 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 404 len: 111 microversion: 2.20 time: 0.028486 Jan 15 16:18:54.608883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 865/1730] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Jan 15 16:18:54 2022] DELETE /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:18:54.616534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:54.617392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] [instance: a62b0ad3-733e-4543-8395-a9ebb0de6702] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:54.624746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:54.625304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:54.626146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:54.626585 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:54.639789 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] HTTP exception thrown: Instance a62b0ad3-733e-4543-8395-a9ebb0de6702 could not be found. Jan 15 16:18:54.640462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] Returning 404 to user: Instance a62b0ad3-733e-4543-8395-a9ebb0de6702 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:18:54.641562 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dee870ee-7c5d-45dc-b576-ebc76f6880b3 tempest-AttachVolumeShelveTestJSON-1586956471 tempest-AttachVolumeShelveTestJSON-1586956471-project] 10.222.0.36 "GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702" status: 404 len: 111 microversion: 2.20 time: 0.028480 Jan 15 16:18:54.641920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 866/1731] 10.222.0.36 () {60 vars in 1276 bytes} [Sat Jan 15 16:18:54 2022] GET /compute/v2.1/servers/a62b0ad3-733e-4543-8395-a9ebb0de6702 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:18:54.880752 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:54.881427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:54.887169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:54.888483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:54.888609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:54.889023 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:54.961691 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:54.969965 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b5c6485d-cd52-46f7-9dac-3519df450cc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.092895 Jan 15 16:18:54.970538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 866/1732] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:18:55.987866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:55.988452 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:55.994572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:55.995018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:55.996041 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:55.996505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:56.063032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:56.071879 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3b10d332-086e-40d4-852f-419aa2a620c1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.088701 Jan 15 16:18:56.072882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 867/1733] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:57.088743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:57.089420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:57.095797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:57.100802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:57.100802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:57.100802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:57.192223 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:57.200275 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1910dc8d-48c9-4f7f-853d-167987b677e3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.115210 Jan 15 16:18:57.201505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 867/1734] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:58.218294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:58.218986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:58.226528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:58.227114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:58.228081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:58.228641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:58.300216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:58.308528 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4a861382-4b36-4db1-ab37-d440a7d3f996 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.094904 Jan 15 16:18:58.308877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 868/1735] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:18:59.324334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:18:59.324993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:18:59.331265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:59.331726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:59.332551 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:18:59.333051 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:18:59.393308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:18:59.401188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-920f6abf-8499-448f-8178-a3a2dc0c528d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080422 Jan 15 16:18:59.401756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 868/1736] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:18:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:19:00.025814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f78e5d25-31f9-4792-a775-3c8d27d742d2 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Action: 'create', calling method: .version_select at 0x7f21636333a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-376837893", "metadata": {"Type": "work"}}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:19:00.027175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f78e5d25-31f9-4792-a775-3c8d27d742d2 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:19:00.027973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f78e5d25-31f9-4792-a775-3c8d27d742d2 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.112528 Jan 15 16:19:00.028931 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 869/1737] 10.222.0.36 () {60 vars in 1155 bytes} [Sat Jan 15 16:18:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:19:00.037469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-552bd6fe-814d-4ae0-99c9-fe24e23533e8 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Action: 'create', calling method: .version_select at 0x7f2168279820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-150954727", "metadata": {"Type": "work"}}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:19:00.038970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-552bd6fe-814d-4ae0-99c9-fe24e23533e8 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:19:00.039771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-552bd6fe-814d-4ae0-99c9-fe24e23533e8 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005982 Jan 15 16:19:00.040313 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 869/1738] 10.222.0.36 () {60 vars in 1155 bytes} [Sat Jan 15 16:19:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:19:00.048620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-751c81be-36be-4a96-a36d-c297ce423ad7 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Action: 'create', calling method: .version_select at 0x7f216ca8c0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681700909", "metadata": {"Type": "work"}}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:19:00.049782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-751c81be-36be-4a96-a36d-c297ce423ad7 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:19:00.050595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-751c81be-36be-4a96-a36d-c297ce423ad7 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005604 Jan 15 16:19:00.051096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 870/1739] 10.222.0.36 () {60 vars in 1155 bytes} [Sat Jan 15 16:19:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:19:00.058893 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1c829c33-3e99-4529-9599-54a6eb48782d tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Calling method '.version_select at 0x7f21681f3d30>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:00.418491 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:00.419093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:00.425497 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:00.425943 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:00.426717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:00.427158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:00.484840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:00.492508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-46012533-919c-4f86-afd6-fe6f460a656a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077539 Jan 15 16:19:00.493077 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 871/1740] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:01.509988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:01.510609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:01.517714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:01.518166 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:01.518987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:01.519390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:01.581708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:01.589373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6b5adabc-f57e-46b2-bb1e-8e4d5ff608ca tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083043 Jan 15 16:19:01.589958 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 872/1741] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:02.606010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:02.607116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:02.613244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:02.613689 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:02.614455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:02.614886 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:02.673652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:02.681254 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8c5c1a86-e799-4c46-a1b6-7f784f8ba260 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079057 Jan 15 16:19:02.681810 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 873/1742] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:03.698085 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:03.698696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:03.705765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:03.706209 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:03.706981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:03.707414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:03.766022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:03.773662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7e5df7aa-1f0c-4751-8690-2e5af447114b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079197 Jan 15 16:19:03.774227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 874/1743] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:19:04.790475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:04.791087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:04.797557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:04.798002 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:04.798772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:04.799206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:04.860099 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:04.867686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5a08a40f-ba1f-493b-9119-0c18d039d76c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080875 Jan 15 16:19:04.868266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 875/1744] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:04 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:05.884849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:05.885478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:05.891685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:05.892129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:05.892946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:05.893379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:05.951666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:05.959240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dee7ba5e-4020-467d-ab65-e2367e8e9af8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078151 Jan 15 16:19:05.959802 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 876/1745] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:06.976239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:06.976882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:06.983518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:06.983957 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:06.984758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:06.985189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:07.046264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:07.052767 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2be36115-518a-4b78-9f3c-6e510e7c2fcb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080225 Jan 15 16:19:07.053335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 877/1746] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:08.069129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:08.069723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:08.076637 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:08.077082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:08.077852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:08.078285 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:08.141727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:08.149284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bb19693b-522d-484b-965a-f76d44679d11 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083794 Jan 15 16:19:08.149848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 878/1747] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:09.166679 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:09.167293 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:09.174073 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:09.174525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:09.175294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:09.175727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:09.232883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:09.240439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-70125463-08e6-44f3-ab7a-f3c3db532dc8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077477 Jan 15 16:19:09.241000 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 879/1748] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:10.257011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:10.257664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:10.264478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:10.264928 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:10.265706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:10.266143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:10.323560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:10.331783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f7a22ccf-626c-4870-b788-4db764123076 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078407 Jan 15 16:19:10.332390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 880/1749] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:11.348919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:11.349536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:11.355734 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:11.356216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:11.357770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:11.358219 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:11.416037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:11.424289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-152f52fc-8241-460b-8bc6-d8a60401a6da tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079051 Jan 15 16:19:11.424856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 881/1750] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:12.441042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:12.441977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:12.447995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:12.448476 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:12.449262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:12.449700 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:12.514262 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:12.522437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9e7a332f-bd29-4406-ae95-bb1558a41f71 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085037 Jan 15 16:19:12.523018 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 882/1751] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:13.539137 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:13.539799 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:13.546288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:13.546767 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:13.547559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:13.547996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:13.610104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:13.617682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7c3801df-3f62-43cf-b15d-dac45b6da9c7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082520 Jan 15 16:19:13.618246 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 883/1752] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:14.634441 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:14.635122 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:14.642022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:14.642464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:14.643239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:14.643687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:14.705608 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:14.713274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-197d622e-1af0-4314-9ed5-2016aeb28e5d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082459 Jan 15 16:19:14.713826 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 884/1753] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:15.730270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:15.730884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:15.737178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:15.737625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:15.738403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:15.738842 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:15.800036 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:15.807686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a3360993-956a-463e-bd82-df9d66e70f1d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081075 Jan 15 16:19:15.808274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 885/1754] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:16.824632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:16.825361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:16.831602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:16.832053 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:16.832884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:16.833321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:16.893321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:16.900948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-85f1cff9-a756-46a6-bc84-f011d8854e19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080058 Jan 15 16:19:16.901537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 886/1755] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:17.917394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:17.918009 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:17.924356 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:17.924808 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:17.925588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:17.926026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:17.983940 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:17.991568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1edc58cd-94b0-4c7b-85b5-ea522cd678c5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077852 Jan 15 16:19:17.992156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 887/1756] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:19.009172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:19.009832 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:19.016943 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:19.017378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:19.018193 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:19.018627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:19.077954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:19.085765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d6853262-8bbe-4070-8b05-ab6c6b2180c8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080320 Jan 15 16:19:19.086328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 888/1757] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:20.102499 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:20.103134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:20.110156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:20.110599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:20.111368 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:20.111798 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:20.171205 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:20.179088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3db2aee9-3d73-4316-8901-3d64ca7a0249 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080187 Jan 15 16:19:20.179659 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 889/1758] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:21.195841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:21.196502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:21.203311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:21.203760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:21.204573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:21.205012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:21.265756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:21.273419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a0683a73-3462-4d18-aa35-2906e909e897 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081238 Jan 15 16:19:21.273986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 890/1759] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:22.289419 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:22.290037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:22.296405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:22.296854 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:22.297661 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:22.298095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:22.356161 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:22.363908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-43379f3c-360e-4580-bef4-61b8f26514d6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078221 Jan 15 16:19:22.364512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 891/1760] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:23.380271 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:23.380946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:23.387987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:23.388552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:23.389424 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:23.389889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:23.447762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:23.456287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2cdc13cb-d12f-4605-bb08-c5304706a587 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079849 Jan 15 16:19:23.456854 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 892/1761] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:24.472722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:24.473373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:24.479582 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:24.482516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:24.482516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:24.482516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:24.540607 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:24.548520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f4ad6ac8-deff-4f32-b28b-8bb9295ec519 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079367 Jan 15 16:19:24.549082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 893/1762] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:25.565079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:25.565754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:25.571880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:25.572365 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:25.573134 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:25.573568 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:25.631403 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:25.639221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a6cb4689-5ade-42d0-9eb1-eefab5a55d39 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077898 Jan 15 16:19:25.639782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 894/1763] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:26.656427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:26.657185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:26.663242 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:26.663682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:26.664489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:26.664920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:26.723764 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:26.731658 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c97f7fae-46f8-4d50-82f4-3cd620335cac tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079331 Jan 15 16:19:26.732239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 895/1764] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:27.748600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:27.749212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:27.755353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:27.755907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:27.756720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:27.757156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:27.818639 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:27.826659 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-94934803-bac1-40d6-8459-6928c75a37b8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082260 Jan 15 16:19:27.827231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 896/1765] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:28.843901 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:28.844627 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:28.851387 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:28.851845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:28.852657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:28.853095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:28.911818 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:28.919557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9687d55d-e366-414d-afe8-f1f0705fe860 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080030 Jan 15 16:19:28.920115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 897/1766] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:29.935937 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:29.936626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:29.942847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:29.943296 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:29.944072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:29.944551 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:30.003447 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:30.011119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3221fb89-b3ac-4e38-ad5f-7ca11054aab5 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078880 Jan 15 16:19:30.011688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 898/1767] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:31.027383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:31.028162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:31.034532 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:31.034989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:31.035780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:31.036247 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:31.094803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:31.102680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-281ca9f3-0b97-48db-aae7-7edc51e46c55 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079100 Jan 15 16:19:31.103253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 899/1768] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:32.121146 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:32.121819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:32.127626 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:32.128054 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:32.128859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:32.129297 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:32.189651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:32.197464 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-782bd6e8-cc08-420b-8c40-3b8b950f9211 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080478 Jan 15 16:19:32.198028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 900/1769] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:33.214516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:33.215165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:33.221593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:33.222045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:33.222818 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:33.223264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:33.281154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:33.288727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e3bda934-5099-4dee-83af-14ad6cf432af tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077919 Jan 15 16:19:33.289289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 901/1770] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:19:34.305718 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:34.306357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:34.313152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:34.313600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:34.314377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:34.314817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:34.376282 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:34.384079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-62254558-e981-4fd1-8a2f-3279e78d7627 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082091 Jan 15 16:19:34.384682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 902/1771] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:35.400042 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:35.400707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:35.407471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:35.407924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:35.408732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:35.409175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:35.467656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:35.475330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9f58319c-49ed-43e1-8ecf-a04078be8623 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079011 Jan 15 16:19:35.475888 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 903/1772] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:36.492437 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:36.493066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:36.499451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:36.499893 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:36.500688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:36.501124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:36.559442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:36.567129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-92315558-e26f-4cb9-8a99-8dd942194453 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078372 Jan 15 16:19:36.567696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 904/1773] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:37.584010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:37.584760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:37.590966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:37.591525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:37.592332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:37.592775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:37.651145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:37.658977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-021d7c59-1d10-4c7c-8b7c-c4494e6bcc76 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078671 Jan 15 16:19:37.659538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 905/1774] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:38.674511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:38.675303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:38.681552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:38.682031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:38.682812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:38.683253 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:38.742505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:38.750765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-764b36c3-6a51-43ca-bd0a-b153946dae75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079866 Jan 15 16:19:38.751321 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 906/1775] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:19:39.767065 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:39.767666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:39.773997 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:39.778628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:39.778628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:39.778628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:39.834845 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:39.843200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7be61583-cee7-4864-bfe5-8251b6bdd92a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080089 Jan 15 16:19:39.843754 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 907/1776] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:40.859951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:40.860711 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:40.866961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:40.867408 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:40.868200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:40.868635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:40.929575 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:40.937352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c4066c82-50cf-44ed-90a1-e731809f55d1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081447 Jan 15 16:19:40.937906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 908/1777] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:41.953866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:41.954465 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:41.960698 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:41.961156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:41.961939 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:41.962377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:42.021031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:42.029372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a632759d-8fc8-4487-97ac-d4f8f3c86bee tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079273 Jan 15 16:19:42.029945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 909/1778] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:43.046061 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:43.046682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:43.052909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:43.053353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:43.054126 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:43.054556 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:43.118063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:43.126426 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-893c8b3b-84b9-4c4f-b557-d42b00c66845 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.084852 Jan 15 16:19:43.126998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 910/1779] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:44.142848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:44.143500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:44.149785 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:44.150243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:44.151032 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:44.151477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:44.210455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:44.218751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ed27b773-b577-4330-97fe-fa5c38ca2efb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079588 Jan 15 16:19:44.219581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 911/1780] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:45.235201 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:45.235827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:45.241984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:45.242429 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:45.243196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:45.243630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:45.302160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:45.310651 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a8d8301e-1a4a-4cc6-809b-b437b5b63b6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079082 Jan 15 16:19:45.311208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 912/1781] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:46.327432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:46.328031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:46.334190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:46.334634 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:46.335404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:46.335838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:46.396463 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:46.404530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4614d156-6677-476d-af79-79d628f7ba14 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081650 Jan 15 16:19:46.405092 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 913/1782] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:47.420518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:47.421157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:47.427524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:47.427969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:47.428788 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:47.429217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:47.493596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:47.502197 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-699e8293-e8a1-45a5-bc04-42f3d75bb799 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085559 Jan 15 16:19:47.502779 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 914/1783] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:48.519238 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:48.519914 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:48.526203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:48.526645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:48.527421 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:48.528629 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:48.588542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:48.597011 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f7f36161-a0a1-4a3d-9597-00eb8663c164 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081629 Jan 15 16:19:48.597579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 915/1784] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:19:49.613998 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:49.614696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:49.621322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:49.622561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:49.623352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:49.623797 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:49.682106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:49.690267 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ab2009bb-a5be-4efc-bef7-b1510910ff03 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080114 Jan 15 16:19:49.690835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 916/1785] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:50.706569 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:50.707216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:50.713463 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:50.713913 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:50.714687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:50.715125 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:50.774121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:50.781873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-aa13800a-7bd7-4a4b-810e-4be75fc800db tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079020 Jan 15 16:19:50.782443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 917/1786] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:51.798841 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:51.799436 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:51.805704 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:51.806152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:51.806925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:51.807360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:51.866308 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:51.874235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-acdc33fd-5a39-412f-854e-7850cb4a5fa1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079028 Jan 15 16:19:51.874813 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 918/1787] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:52.891343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:52.892008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:52.898148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:52.898592 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:52.899362 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:52.899819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:52.958666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:52.966919 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-eee0b14a-f397-4a9a-8067-5980d33a4f47 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080016 Jan 15 16:19:52.967485 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 919/1788] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:53.984055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:53.984703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:53.990801 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:53.991244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:53.992013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:53.992478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:54.055096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:54.063357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-eb82aac4-59d2-4513-950d-cff349b12e1f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083899 Jan 15 16:19:54.063929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 920/1789] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:55.080024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:55.080685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:55.086904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:55.087359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:55.088152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:55.088596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:55.147048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:55.155239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8aa48c8c-0803-466f-89fc-573da3f2bea9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078855 Jan 15 16:19:55.155803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 921/1790] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:56.171659 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:56.172318 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:56.178581 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:56.182330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:56.182330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:56.182330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:56.238304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:56.246477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6af63768-2469-4c45-82b6-b433b010dee2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078875 Jan 15 16:19:56.247037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 922/1791] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:57.263640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:57.264328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:57.270502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:57.270952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:57.271729 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:57.272188 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:57.330835 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:57.338500 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2849aebe-879a-4f40-aed7-b50f014d4f97 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079175 Jan 15 16:19:57.339068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 923/1792] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:58.355141 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:58.356468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:58.362652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:58.363103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:58.363885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:58.364370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:58.423270 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:58.430897 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d7c48d89-da85-4a96-a169-f1f54d401f01 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079561 Jan 15 16:19:58.431469 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 924/1793] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:19:59.448243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:19:59.451915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:19:59.456404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:59.456882 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:59.458327 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:19:59.458774 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:19:59.519274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:19:59.527055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bcdd750c-6b51-476c-987b-2738dc4cfdda tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082551 Jan 15 16:19:59.527821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 925/1794] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:19:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:00.120009 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a60092bd-8c65-4b72-bb39-923f67b7cbfa tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Calling method '.version_select at 0x7f216ca364c0>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:07.917723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-1c829c33-3e99-4529-9599-54a6eb48782d tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] HTTP exception thrown: Volume tempest-invalid-1854236143 could not be found. Jan 15 16:20:07.917723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1c829c33-3e99-4529-9599-54a6eb48782d tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 404 to user: Volume tempest-invalid-1854236143 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:20:07.918795 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1c829c33-3e99-4529-9599-54a6eb48782d tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1854236143" status: 404 len: 99 microversion: 2.1 time: 67.862018 Jan 15 16:20:07.919406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 870/1795] 10.222.0.36 () {58 vars in 1217 bytes} [Sat Jan 15 16:19:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1854236143 => generated 99 bytes in 67864 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 16:20:07.925266 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:07.925956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:07.931828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:07.932325 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:07.933107 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:07.933649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:07.983334 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-a60092bd-8c65-4b72-bb39-923f67b7cbfa tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] HTTP exception thrown: Volume tempest-invalid-1854236143 could not be found. Jan 15 16:20:07.983932 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a60092bd-8c65-4b72-bb39-923f67b7cbfa tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 404 to user: Volume tempest-invalid-1854236143 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:20:07.985124 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a60092bd-8c65-4b72-bb39-923f67b7cbfa tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1854236143" status: 404 len: 99 microversion: 2.1 time: 7.869094 Jan 15 16:20:07.985697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 926/1796] 10.222.0.36 () {58 vars in 1217 bytes} [Sat Jan 15 16:20:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1854236143 => generated 99 bytes in 7870 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 15 16:20:07.993072 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:07.993567 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:07.998570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:08.001168 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:08.001615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:08.003207 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:08.003652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:08.007967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b8c13dff-0ae6-4931-9350-e5314c874061 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.087518 Jan 15 16:20:08.008842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 871/1797] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:20:08.014447 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2780c34e-c70a-491f-b3f9-2d5319793ed3 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004566 Jan 15 16:20:08.015098 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 872/1798] 10.222.0.36 () {58 vars in 1139 bytes} [Sat Jan 15 16:20:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 15 16:20:08.018781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] HTTP exception thrown: Instance 78be13e2-d439-46ac-9d73-637377b4af0c could not be found. Jan 15 16:20:08.019468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Returning 404 to user: Instance 78be13e2-d439-46ac-9d73-637377b4af0c could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:20:08.020329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-31071b09-9f90-4423-9df5-ddb51a2c2c8a tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 404 len: 111 microversion: 2.1 time: 0.032412 Jan 15 16:20:08.026948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 927/1799] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:20:07 2022] DELETE /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:20:08.028749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-53f939b4-ec55-4bbb-9dbf-483541ee063f tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003838 Jan 15 16:20:08.028749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 873/1800] 10.222.0.36 () {58 vars in 1136 bytes} [Sat Jan 15 16:20:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 15 16:20:08.035082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:08.035446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2229329a-39b3-415b-90b9-695a3714c737 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Calling method '.version_select at 0x7f2168062280>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:08.035909 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] [instance: 78be13e2-d439-46ac-9d73-637377b4af0c] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:08.042337 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:08.042866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:08.044228 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:08.044675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:08.058082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] HTTP exception thrown: Instance 78be13e2-d439-46ac-9d73-637377b4af0c could not be found. Jan 15 16:20:08.059511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] Returning 404 to user: Instance 78be13e2-d439-46ac-9d73-637377b4af0c could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:20:08.059707 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-230261be-3297-4889-a616-8d1ea08ca9ec tempest-AttachVolumeTestJSON-608082187 tempest-AttachVolumeTestJSON-608082187-project] 10.222.0.36 "GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c" status: 404 len: 111 microversion: 2.1 time: 0.028248 Jan 15 16:20:08.060269 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 928/1801] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:08 2022] GET /compute/v2.1/servers/78be13e2-d439-46ac-9d73-637377b4af0c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:20:09.025154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:09.026537 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:09.034178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:09.034960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:09.035839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:09.036384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:09.097829 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:09.106756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-13b9feba-fc44-4f90-9bfb-a86f408f1c73 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085511 Jan 15 16:20:09.107332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 929/1802] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:10.124666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:10.125310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:10.131633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:10.132086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:10.132910 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:10.133352 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:10.198031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:10.205906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-82cb98a0-8777-4e8f-a681-100307c3347a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.085819 Jan 15 16:20:10.206415 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 930/1803] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:11.222753 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:11.223390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:11.234603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:11.234603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:11.234603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:11.234603 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:11.321135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:11.332064 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-98a5b567-f253-4251-809b-84f6f917b2c6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.113052 Jan 15 16:20:11.332877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 931/1804] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:12.349174 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:12.349978 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:12.356847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:12.357303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:12.358101 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:12.358546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:12.441641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:12.450081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-aa4ae4b5-335e-4dca-a668-21a2b3a907ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.104527 Jan 15 16:20:12.450595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 932/1805] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:13.467330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:13.467973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:13.474686 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:13.475135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:13.475918 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:13.476427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:13.541965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:13.550723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6157721d-57fc-48f1-b0ef-a4b6e71d4f5e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.087700 Jan 15 16:20:13.551795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 933/1806] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:14.567990 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:14.568696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:14.576156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:14.576610 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:14.577379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:14.577809 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:14.641371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:14.648973 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-82caa00d-04ea-4635-9993-592018ac1b3e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.084708 Jan 15 16:20:14.649563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 934/1807] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:15.666286 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:15.666948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:15.673635 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:15.674081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:15.674878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:15.675312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:15.736422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:15.744314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9fcc21ab-ff77-4fc8-ade0-6f21a54e8824 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081377 Jan 15 16:20:15.744871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 935/1808] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:16.761771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:16.762446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:16.768622 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:16.769069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:16.769838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:16.770265 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:16.830078 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:16.837724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8c0a9a59-fcc5-4179-a4a5-508612b0d881 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080163 Jan 15 16:20:16.838284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 936/1809] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:16 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:17.854678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:17.856115 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:17.862345 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:17.862790 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:17.863555 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:17.863986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:17.924010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:17.931601 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fef1d080-d506-4645-8015-488b0a66aa92 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080657 Jan 15 16:20:17.932176 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 937/1810] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:18.948064 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:18.949332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:18.955682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:18.956128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:18.956934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:18.957367 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:19.016484 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:19.024332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9f6f2f61-7346-463e-9820-d7dd82ba3101 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079803 Jan 15 16:20:19.024904 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 938/1811] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:20.040330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:20.040945 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:20.047602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:20.048051 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:20.048877 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:20.049319 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:20.108465 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:20.116181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-065ba308-fd1a-4880-b457-c21226fbbb19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079480 Jan 15 16:20:20.116752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 939/1812] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:21.133311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:21.133956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:21.140347 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:21.140827 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:21.141590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:21.142033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:21.202714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:21.210359 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-69406127-108d-433b-8c78-0ce7c72f5f7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080719 Jan 15 16:20:21.210924 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 940/1813] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:22.227985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:22.228668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:22.235370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:22.235821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:22.236656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:22.237106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:22.296057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:22.303840 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5e689b67-08c8-4a43-8451-2d9efec69751 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079486 Jan 15 16:20:22.309640 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 941/1814] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:23.320199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:23.320861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:23.327853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:23.338502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:23.338502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:23.338502 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:23.392259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:23.399962 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9d8b4aa3-8a78-4aea-a1d0-08008677888c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083589 Jan 15 16:20:23.400563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 942/1815] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:24.416915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:24.417933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:24.424128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:24.424609 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:24.425648 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:24.426098 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:24.484563 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:24.492405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5bad866d-bf80-4d0b-97a0-f823734d78a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079093 Jan 15 16:20:24.492970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 943/1816] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:20:25.509300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:25.509946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:25.516385 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:25.516830 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:25.517598 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:25.518030 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:25.577103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:25.584633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b3fa01dc-3c07-4db2-aee5-1eee9bf305a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078990 Jan 15 16:20:25.585194 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 944/1817] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:26.601796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:26.602456 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:26.609264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:26.609716 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:26.610510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:26.610928 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:26.670667 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:26.678327 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6e443a67-c0b7-46a1-a840-644e2139558f tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080215 Jan 15 16:20:26.678891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 945/1818] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:27.694509 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:27.695222 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:27.702280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:27.702739 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:27.703525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:27.703964 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:27.765597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:27.773314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e5197263-0ae4-460a-a148-d7fd935708fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082490 Jan 15 16:20:27.773889 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 946/1819] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:28.790103 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:28.790770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:28.797212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:28.797657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:28.798427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:28.798859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:28.858227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:28.866207 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8acbdaa3-7880-499a-8591-6e39ca87a7eb tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079456 Jan 15 16:20:28.866771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 947/1820] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:28 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:29.882680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:29.883305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:29.890206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:29.890650 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:29.891418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:29.891848 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:29.949856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:29.957335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0ac37b65-7efa-4a42-9986-e28abae240ff tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078302 Jan 15 16:20:29.957930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 948/1821] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:30.973656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:30.974320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:30.981463 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:30.981908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:30.982675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:30.983109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:31.045338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:31.053384 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fac61ab2-9755-45c6-b9a6-e5394571ed00 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083364 Jan 15 16:20:31.054154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 949/1822] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:32.070059 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:32.070652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:32.076533 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:32.076980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:32.077746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:32.078180 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:32.137529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:32.145155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-cc0f0e93-d79b-4b41-8ab9-19d770aab05a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078914 Jan 15 16:20:32.145720 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 950/1823] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:33.162217 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:33.162857 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:33.169633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:33.170081 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:33.170846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:33.171278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:33.230933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:33.238496 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-63f55267-f8bc-4e33-a491-e1ac4152ce3d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079912 Jan 15 16:20:33.239057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 951/1824] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:34.256048 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:34.256822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:34.263312 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:34.263759 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:34.264578 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:34.265016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:34.327245 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:34.334940 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1b2a6865-f31e-44d7-b8a8-43aec80c26a4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082785 Jan 15 16:20:34.335510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 952/1825] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:35.351586 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:35.352250 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:35.358762 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:35.359204 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:35.359969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:35.360431 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:35.419496 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:35.426992 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b40b66cd-bfab-4774-ade2-669112375b60 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079098 Jan 15 16:20:35.427546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 953/1826] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:36.443261 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:36.443911 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:36.450833 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:36.451287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:36.452067 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:36.452538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:36.511498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:36.519187 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b9a5671f-88af-4073-b333-806def4cee75 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079555 Jan 15 16:20:36.519760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 954/1827] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:37.536249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:37.536933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:37.543157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:37.543607 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:37.544416 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:37.544853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:37.605227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:37.611632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6cdcd7bd-b438-4512-b322-785824b6efde tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079100 Jan 15 16:20:37.612220 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 955/1828] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:38.628664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:38.629336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:38.636275 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:38.636769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:38.637527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:38.637968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:38.697512 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:38.705856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ab11bdb1-ced4-4e0a-8e0d-40cd8b06f281 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080874 Jan 15 16:20:38.706422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 956/1829] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:39.723516 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:39.724236 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:39.731322 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:39.731781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:39.732600 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:39.733044 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:39.797257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:39.805885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f627ad6d-8222-4be6-8cb3-8d8a44e83d36 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.086241 Jan 15 16:20:39.806449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 957/1830] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:39 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:40.823069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:40.823843 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:40.829898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:40.830342 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:40.831106 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:40.831536 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:40.892928 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:40.900752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8a6e6b55-8214-4245-bbd7-3316d0b9e212 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081266 Jan 15 16:20:40.901492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 958/1831] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:41.917372 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:41.918615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:41.925169 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:41.925614 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:41.926389 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:41.926820 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:41.985728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:41.993664 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-fd080e8e-4d0c-4931-a7ba-8341f583df18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079637 Jan 15 16:20:41.994235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 959/1832] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:43.010033 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:43.011486 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:43.017751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:43.018196 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:43.018965 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:43.019398 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:43.078414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:43.086105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a71d6f54-0416-425d-bb85-65e4770cd7d4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079769 Jan 15 16:20:43.086670 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 960/1833] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:44.102547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:44.103175 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:44.109994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:44.110444 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:44.111221 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:44.111662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:44.173521 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:44.181259 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c10e5752-b87c-45be-b600-e611fb27b142 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082361 Jan 15 16:20:44.181821 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 961/1834] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:45.198727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:45.199374 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:45.205557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:45.206005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:45.206778 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:45.207218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:45.265138 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:45.272629 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8a3653cf-9185-417e-93c9-cc8ab5648b46 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078404 Jan 15 16:20:45.273200 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 962/1835] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:46.288920 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:46.289612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:46.296457 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:46.296905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:46.297676 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:46.298113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:46.356752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:46.364272 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d7ed664b-0e77-42eb-8eb6-fec1e13cddc0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079000 Jan 15 16:20:46.364838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 963/1836] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:47.381088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:47.381702 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:47.388636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:47.389107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:47.389891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:47.390329 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:47.457314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:47.465164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-daccd357-b2c3-4584-8347-c659e6fb0137 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.087745 Jan 15 16:20:47.465749 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 964/1837] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:48.483663 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:48.484367 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:48.490508 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:48.490954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:48.491723 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:48.492172 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:48.550951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:48.559066 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b9f781d3-62ad-457e-98ab-fd85beabffdd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080627 Jan 15 16:20:48.559630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 965/1838] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:49.576256 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:49.576929 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:49.583129 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:49.583577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:49.584395 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:49.584839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:49.644043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:49.651782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f045d785-7939-446d-bdea-009792817cbd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079973 Jan 15 16:20:49.652453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 966/1839] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:50.668291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:50.668995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:50.675151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:50.675606 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:50.676418 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:50.676864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:50.736108 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:50.744013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-51b8c7b3-3c23-4068-9c4d-d64a08fbf760 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079483 Jan 15 16:20:50.744615 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 967/1840] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:51.760535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:51.761170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:51.767332 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:51.767783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:51.768597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:51.769037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:51.827092 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:51.834768 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-bb5d3687-511b-4b65-a857-f2e116e98989 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078043 Jan 15 16:20:51.835333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 968/1841] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:51 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:52.851668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:52.852388 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:52.859274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:52.859724 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:52.860525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:52.860968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:52.919795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:52.927446 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0905c1d9-4b36-4e36-afe9-65dea5c2cc7e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079446 Jan 15 16:20:52.928010 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 969/1842] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:53.944330 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:53.944954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:53.951908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:53.952393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:53.953176 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:53.953612 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:54.016597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:54.024343 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1e9f00c0-eb52-4ff5-bcee-67189daca6a6 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083671 Jan 15 16:20:54.024908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 970/1843] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:54.325146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jan 15 16:20:54.347871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:20:54.348036 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:20:54.664188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-2229329a-39b3-415b-90b9-695a3714c737 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] HTTP exception thrown: Volume f67105dc-08a7-4a8d-a0e0-c4f0e5543ab0 could not be found. Jan 15 16:20:54.664797 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2229329a-39b3-415b-90b9-695a3714c737 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 404 to user: Volume f67105dc-08a7-4a8d-a0e0-c4f0e5543ab0 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:20:54.665622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2229329a-39b3-415b-90b9-695a3714c737 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/f67105dc-08a7-4a8d-a0e0-c4f0e5543ab0" status: 404 len: 109 microversion: 2.1 time: 46.633613 Jan 15 16:20:54.666165 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 874/1844] 10.222.0.36 () {58 vars in 1247 bytes} [Sat Jan 15 16:20:08 2022] DELETE /compute/v2.1/os-volumes/f67105dc-08a7-4a8d-a0e0-c4f0e5543ab0 => generated 109 bytes in 46635 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 16:20:54.676590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4b2c7552-e680-4ae9-a3ca-6ba5c556a194 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Calling method '.version_select at 0x7f21694b3b80>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:55.040890 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:55.042001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:55.048056 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:55.048539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:55.049323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:55.049762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:55.108342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:55.116171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0da5b146-08b5-40b5-83b1-f47627c79a56 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079525 Jan 15 16:20:55.116718 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 875/1845] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:55 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:56.135045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:56.135938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:56.142885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:56.143344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:56.144163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:56.144602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:56.205470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:56.213043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3aefeb3b-42b1-43c2-9ab4-9a4fd8ce7f70 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082693 Jan 15 16:20:56.213593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 876/1846] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:56 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:57.230216 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:57.230876 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:57.237099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:57.237554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:57.238330 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:57.238769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:57.298730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:57.306418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-16fc7afd-f7ef-4ab0-9442-e32988fe9059 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080509 Jan 15 16:20:57.307005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 877/1847] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:57 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:58.323339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:58.323962 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:58.330113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:58.330568 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:58.331350 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:58.331790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:58.391599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:58.399263 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-01040cdd-60d1-43c8-8e54-130a93c62013 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080165 Jan 15 16:20:58.399819 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 878/1848] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:58 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:20:59.417064 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:20:59.417699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:20:59.423862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:59.424353 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:59.425129 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:20:59.425560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:20:59.486609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:20:59.495246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1f40538c-a710-478a-8d9f-569d8924ef7a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082197 Jan 15 16:20:59.495820 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 879/1849] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:20:59 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:00.512348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:00.513011 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:00.519131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:00.519578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:00.520396 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:00.520817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:00.581301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:00.589635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d8616d1-1f07-43d6-bc6a-8246c6d45dc1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082105 Jan 15 16:21:00.590183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 880/1850] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:00 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:01.606804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:01.607434 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:01.613580 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:01.614038 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:01.614823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:01.615270 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:01.673619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:01.681286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-69dc98b3-931e-4338-9702-6e5b753b6479 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078888 Jan 15 16:21:01.682228 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 881/1851] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:01 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:02.006174 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:21:02.006708 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:21:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/1db7a9fc-383c-4079-8074-40f5511d6e20 (ip 10.222.0.36) !!! Jan 15 16:21:02.698014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:02.698644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:02.704970 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:02.705430 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:02.706220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:02.706661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:02.918188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:02.926013 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9d04550a-7573-4888-b438-f544ae498b65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.231854 Jan 15 16:21:02.926582 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 882/1852] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:02 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:03.942449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:03.943125 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:03.949692 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:03.950137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:03.950906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:03.951340 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:04.009576 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:04.018264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a1d59552-f4ef-4356-aa4d-baa1e1c63099 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079509 Jan 15 16:21:04.018832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 883/1853] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:03 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:05.034643 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:05.035343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:05.042479 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:05.042931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:05.043713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:05.044176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:05.102657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:05.111008 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-973bb57a-cb10-4e2f-95d5-f2c3045df901 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080133 Jan 15 16:21:05.111570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 884/1854] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:05 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:06.128309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:06.128925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:06.135159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:06.135609 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:06.136444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:06.136882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:06.196408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:06.204084 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-18a91e92-82d9-45be-bc5a-15ee2eb7ed96 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079417 Jan 15 16:21:06.204686 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 885/1855] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:06 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:07.221090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:07.221719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:07.227908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:07.228421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:07.229357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:07.229800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:07.290971 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:07.298457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-17410fc4-99dc-4b2e-a4c4-7781d9be1f72 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081029 Jan 15 16:21:07.299016 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 886/1856] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:07 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:08.315484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:08.316087 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:08.322444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:08.323043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:08.323817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:08.324285 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:08.382759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:08.390836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c631de8d-0998-4787-82d4-7867b0993342 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079125 Jan 15 16:21:08.391394 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 887/1857] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:09.407408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:09.408053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:09.414339 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:09.414798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:09.415588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:09.416039 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:09.475812 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:09.483554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1d23f8b0-025a-4af8-be39-c149268a3797 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079833 Jan 15 16:21:09.484117 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 888/1858] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:09 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:10.500662 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:10.501307 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:10.507748 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:10.508269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:10.509058 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:10.510169 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:10.568371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:10.576779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-beabf786-3317-4ca9-94cc-80c2678f1e1c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079774 Jan 15 16:21:10.577343 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 889/1859] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:10 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:11.593806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:11.594475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:11.600715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:11.601170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:11.601948 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:11.602385 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:11.662625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:11.670445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f9856d6a-6492-4100-81a0-083f6ff50b19 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080332 Jan 15 16:21:11.671004 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 890/1860] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:11 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:12.687195 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:12.687862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:12.694127 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:12.694581 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:12.695365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:12.695803 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:12.754014 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:12.762467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9c85f0ce-8cf6-4739-b905-aa5d619bdc65 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079074 Jan 15 16:21:12.763029 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 891/1861] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:12 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:13.779171 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:13.779777 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:13.786021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:13.786475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:13.787257 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:13.787697 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:13.848857 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:13.856844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5f5fd38c-e15b-4f00-8e79-efd91f147def tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082074 Jan 15 16:21:13.857407 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 892/1862] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:13 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:14.874921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:14.875710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:14.881400 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:14.881854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:14.882632 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:14.883068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:14.943618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:14.951449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cb777462-069c-4770-8a34-a62061a926d9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081492 Jan 15 16:21:14.952015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 893/1863] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:14 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:21:15.968087 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:15.968817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:15.975015 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:15.975469 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:15.976278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:15.976722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:16.036863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:16.045323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b99cca5b-16b6-41d8-b863-363c8ffab443 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081013 Jan 15 16:21:16.045887 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 894/1864] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:15 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:17.062471 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:17.063085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:17.069482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:17.069934 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:17.070710 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:17.071147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:17.131593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:17.139436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-bc8c05d7-d90b-4c9a-a6b3-d12d3d69482a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080755 Jan 15 16:21:17.140002 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 895/1865] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:17 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:18.156842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:18.157472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:18.163673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:18.164167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:18.164946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:18.165381 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:18.224073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:18.232444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cea78efc-7ec6-45b1-b960-84100a703bab tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079320 Jan 15 16:21:18.233009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 896/1866] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:18 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:21:18.237255 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:21:18.237408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:21:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:21:19.249592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:19.250252 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:19.256488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:19.256941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:19.257730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:19.258170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:19.316722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:19.324361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2b61a924-f3a1-49d0-8169-52e4f6c279dc tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079193 Jan 15 16:21:19.324919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 897/1867] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:19 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:20.340835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:20.341459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:20.347649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:20.348103 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:20.348919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:20.349359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:20.411884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:20.419584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-696b88f7-070b-4e39-9081-90e1711783d3 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082560 Jan 15 16:21:20.420162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 898/1868] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:20 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:21.436010 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:21.436718 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:21.442902 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:21.443357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:21.444133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:21.444598 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:21.503071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:21.511152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3d2283c2-239e-4b49-8ce0-99f5a355f025 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078451 Jan 15 16:21:21.511721 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 899/1869] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:21 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:22.527956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:22.528635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:22.534806 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:22.535260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:22.536036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:22.536502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:22.595530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:22.603132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d2d16157-7497-4219-83e4-98a6bfde10f1 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079403 Jan 15 16:21:22.603699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 900/1870] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:22 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:23.620244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:23.620906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:23.627031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:23.627480 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:23.628290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:23.628726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:23.687635 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:23.695254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-609a9bad-8b14-4dc6-8aef-82d2d0bd84fd tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078931 Jan 15 16:21:23.695834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 901/1871] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:23 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:24.712130 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:24.712769 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:24.719608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:24.720057 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:24.720879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:24.721317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:24.781605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:24.789483 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-37042e67-2f62-4f50-a307-c09b6d47dae4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080998 Jan 15 16:21:24.790140 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 902/1872] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:24 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:25.806482 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:25.807142 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:25.813986 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:25.814442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:25.815225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:25.815661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:25.874910 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:25.882502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-eede8f11-b14e-4277-9b70-8fb67872073a tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079634 Jan 15 16:21:25.883061 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 903/1873] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:25 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:26.899068 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:26.899740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:26.906200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:26.906652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:26.907457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:26.907891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:26.970901 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:26.978671 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-00729935-285c-4de9-9a88-d1b303c84f9b tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.083243 Jan 15 16:21:26.979237 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 904/1874] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:26 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:27.995907 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:27.996588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:28.002747 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:28.003203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:28.003980 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:28.004450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:28.063032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:28.070783 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9ffcfe8b-3026-4089-a274-9fb4522f6fb7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079390 Jan 15 16:21:28.071346 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 905/1875] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:27 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:29.086681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:29.087303 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:29.094371 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:29.094823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:29.095604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:29.096052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:29.155750 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:29.163514 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f44ba471-c2b7-418d-b5e9-0833f18a4cc4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080652 Jan 15 16:21:29.164082 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 906/1876] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:29 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:30.180163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:30.180832 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:30.187685 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:30.188132 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:30.188939 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:30.189378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:30.248871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:30.256373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e29e90b3-ff76-4a9b-bcfe-cf6e86a91e6d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079879 Jan 15 16:21:30.256933 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 907/1877] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:30 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:31.272891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:31.273627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:31.280836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:31.281486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:31.282450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:31.282892 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:31.343374 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:31.351188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-26ffb5fa-1758-4828-a5ec-a9724fdba6f2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082021 Jan 15 16:21:31.351829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 908/1878] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:31 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:32.368455 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:32.369074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:32.375279 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:32.375738 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:32.376554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:32.376996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:32.435449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:32.443075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e17bdc5e-3fca-4fb5-b44a-2865dff56a0d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078675 Jan 15 16:21:32.443638 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 909/1879] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:32 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:33.459281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:33.459956 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:33.465969 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:33.468996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:33.468996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:33.468996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:33.528843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:33.536478 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-dd0b5ddb-5819-4cc8-bb30-0d338bf54a20 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081013 Jan 15 16:21:33.537079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 910/1880] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:33 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:34.553456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:34.554107 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:34.560564 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:34.561021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:34.561811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:34.562253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:34.620583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:34.628246 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0551b913-7430-49cb-aa03-55bfb5689744 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078423 Jan 15 16:21:34.628814 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 911/1881] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:34 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:35.645230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:35.646009 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:35.653001 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:35.653458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:35.654261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:35.654700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:35.715022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:35.722848 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fcb01e17-cec4-421d-a5ad-159657e09b18 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081342 Jan 15 16:21:35.723408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 912/1882] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:35 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:36.741253 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:36.742220 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:36.748957 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:36.749404 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:36.750178 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:36.750610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:36.810488 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:36.818895 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-258cdd3e-dff7-4777-a732-82447b1a2536 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081422 Jan 15 16:21:36.819467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 913/1883] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:36 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:37.835432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:37.836211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:37.843351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:37.845570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:37.845570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:37.845570 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:37.912326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:37.913399 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-80dd9412-ee84-459b-ba80-c6f6e60399e9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081629 Jan 15 16:21:37.913992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 914/1884] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:37 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:38.930372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:38.931018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:38.938003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:38.938451 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:38.939222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:38.939664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:39.000472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:39.008161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3be0bb89-35e3-4be6-9067-b25b152c3381 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081467 Jan 15 16:21:39.008756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 915/1885] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:38 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:40.025166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:40.025794 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:40.032088 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:40.032577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:40.033373 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:40.033818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:40.095145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:40.102759 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-377264b2-bc1e-4740-9556-802bcb63150c tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081359 Jan 15 16:21:40.103337 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 916/1886] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:40 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:41.119817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:41.120454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:41.126885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:41.127336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:41.128111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:41.128569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:41.187141 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:41.194774 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-47481899-f4cc-420d-9e51-f31385485730 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078854 Jan 15 16:21:41.195338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 917/1887] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:41 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:42.211248 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:42.211845 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:42.218252 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:42.218708 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:42.219485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:42.219925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:42.278405 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:42.286003 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3f1074a0-e296-4c4a-933a-2ecfbad61ad4 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078378 Jan 15 16:21:42.286569 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 918/1888] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:42 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:43.303066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:43.303680 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:43.310415 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:43.310872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:43.311662 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:43.312109 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:43.373508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:43.381500 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4cab8de4-a711-4a92-b7de-5b636a6050a7 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.082161 Jan 15 16:21:43.382066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 919/1889] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:43 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:44.398537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:44.399182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:44.405357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:44.405809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:44.406584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:44.407022 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:44.465236 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:44.472861 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-70b48a93-6686-4e49-981a-0c250b21fde2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.077992 Jan 15 16:21:44.473422 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 920/1890] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:44 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:45.489798 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:45.490424 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:45.497173 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:45.497625 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:45.498425 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:45.498860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:45.556732 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:45.565036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ae24f16c-89cd-468b-8567-2656497d9448 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078876 Jan 15 16:21:45.565593 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 921/1891] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:45 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:46.581338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:46.582081 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:46.588271 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:46.588728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:46.589507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:46.590531 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:46.650560 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:46.659464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-237f65f3-4a92-47ff-b895-18b39b3725a9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081720 Jan 15 16:21:46.660070 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 922/1892] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:46 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:47.676555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:47.677222 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:47.683372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:47.684467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:47.685338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:47.685781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:47.743705 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:47.752077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c80034ef-ec7d-4dd9-b1eb-12242719636d tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079148 Jan 15 16:21:47.752676 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 923/1893] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:47 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:48.768784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:48.769454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:48.775614 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:48.776067 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:48.776878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:48.777601 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:48.836008 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:48.843895 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a58f06b7-95df-416e-b397-b79769bff583 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.078709 Jan 15 16:21:48.844507 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 924/1894] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:48 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:49.860484 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:49.861145 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:49.867549 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:49.867997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:49.868834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:49.869272 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:49.929881 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:49.937871 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-54d53410-fdb8-4f92-96f1-095bc797c4f9 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080995 Jan 15 16:21:49.938436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 925/1895] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:49 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:50.953848 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:50.954470 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:50.960715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:50.961180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:50.961967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:50.962411 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:51.020902 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:51.029435 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-66ab6d9b-3b0e-4882-be93-96e4a1e7b9ba tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079156 Jan 15 16:21:51.030024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 926/1896] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:50 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:21:52.046755 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:52.047350 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:52.053892 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:52.054344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:52.055118 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:52.055554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:52.122592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:52.130536 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-e26788c6-a238-4656-bca1-3e67530e43d8 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.088519 Jan 15 16:21:52.131113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 927/1897] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:52 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:53.146530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:53.147137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:53.153489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:53.153930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:53.154698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:53.155131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:53.215891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:53.223467 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3718d3e5-fd1d-4ab1-a6c1-f4f6b6a2f24e tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.080634 Jan 15 16:21:53.224026 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 928/1898] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:53 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:54.240031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:21:54.240693 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:21:54.247356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:54.247811 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:54.248627 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:21:54.249069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:21:54.307673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:21:54.315605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-40b56cd8-7bfb-4af2-9e05-463d604b7ff2 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.079227 Jan 15 16:21:54.316180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 929/1899] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:21:54 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:21:54.736457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-707c1862-4aa1-4f0c-a14c-3c88ae3f5984 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Calling method '.version_select at 0x7f216c958f70>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:08.090413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-4b2c7552-e680-4ae9-a3ca-6ba5c556a194 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] HTTP exception thrown: Volume 1db7a9fc-383c-4079-8074-40f5511d6e20 could not be found. Jan 15 16:22:08.091024 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4b2c7552-e680-4ae9-a3ca-6ba5c556a194 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 404 to user: Volume 1db7a9fc-383c-4079-8074-40f5511d6e20 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:22:08.092038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4b2c7552-e680-4ae9-a3ca-6ba5c556a194 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1db7a9fc-383c-4079-8074-40f5511d6e20" status: 404 len: 109 microversion: 2.1 time: 73.420303 Jan 15 16:22:08.092632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 971/1900] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 16:20:54 2022] GET /compute/v2.1/os-volumes/1db7a9fc-383c-4079-8074-40f5511d6e20 => generated 109 bytes in 73422 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:22:08.098414 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:08.099026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] [instance: ba9275a1-4d53-4571-be72-2b4524364e4a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:08.104863 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:08.105316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:08.106096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:08.106572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:08.167455 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f431ab7b054b618142174b03491104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1d550b942e4fbd824454e5776498d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:08.175725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-415688be-824b-4e7b-82c4-333f28ddcdd0 tempest-ServerRescueNegativeTestJSON-723238263 tempest-ServerRescueNegativeTestJSON-723238263-project] 10.222.0.36 "GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a" status: 200 len: 1352 microversion: 2.1 time: 0.081422 Jan 15 16:22:08.176390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 972/1901] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:08 2022] GET /compute/v2.1/servers/ba9275a1-4d53-4571-be72-2b4524364e4a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:08.205836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-707c1862-4aa1-4f0c-a14c-3c88ae3f5984 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] HTTP exception thrown: Volume 1db7a9fc-383c-4079-8074-40f5511d6e20 could not be found. Jan 15 16:22:08.206446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-707c1862-4aa1-4f0c-a14c-3c88ae3f5984 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] Returning 404 to user: Volume 1db7a9fc-383c-4079-8074-40f5511d6e20 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:22:08.207328 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-707c1862-4aa1-4f0c-a14c-3c88ae3f5984 tempest-VolumesNegativeTest-1139663323 tempest-VolumesNegativeTest-1139663323-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1db7a9fc-383c-4079-8074-40f5511d6e20" status: 404 len: 109 microversion: 2.1 time: 13.474585 Jan 15 16:22:08.208175 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 930/1902] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 16:21:54 2022] GET /compute/v2.1/os-volumes/1db7a9fc-383c-4079-8074-40f5511d6e20 => generated 109 bytes in 13476 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 16:22:14.745815 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1244211391", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "3565f3df-734a-4e0c-b759-c2ee7a743d66"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:22:14.798878 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] validate_networks() for [('3565f3df-734a-4e0c-b759-c2ee7a743d66', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 16:22:15.182529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 16:22:15.182952 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 16:22:15.183459 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 16:22:15.183866 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 16:22:15.184339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 16:22:15.192806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:15.193255 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:15.194069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:15.194503 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:15.209985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:22:15.213834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for user 13df32b632904102baf80323020194b1 and project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:22:15.224793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 16:22:15.227058 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 16:22:15.360986 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e1fa4cb2-17db-4a0c-b9d6-d89d4c873ca1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723938 Jan 15 16:22:15.361706 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 973/1903] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 16:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 16:22:15.372574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-48cf12b7-7235-41df-9aef-5cc69525f851 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:15.373221 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-48cf12b7-7235-41df-9aef-5cc69525f851 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:15.424891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-48cf12b7-7235-41df-9aef-5cc69525f851 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:15.431320 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-48cf12b7-7235-41df-9aef-5cc69525f851 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1218 microversion: 2.1 time: 0.063365 Jan 15 16:22:15.431836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 931/1904] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:15 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:16.447703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2511330f-51a0-4d28-93e5-83a3ef1d844a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:16.448368 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2511330f-51a0-4d28-93e5-83a3ef1d844a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:16.502741 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2511330f-51a0-4d28-93e5-83a3ef1d844a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:16.509324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2511330f-51a0-4d28-93e5-83a3ef1d844a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1218 microversion: 2.1 time: 0.065293 Jan 15 16:22:16.509887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 974/1905] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:16 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:17.527992 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6fa7fd6b-0911-4cc8-8ffc-b9d86c60f951 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:17.528674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6fa7fd6b-0911-4cc8-8ffc-b9d86c60f951 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:17.581771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6fa7fd6b-0911-4cc8-8ffc-b9d86c60f951 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:17.589904 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6fa7fd6b-0911-4cc8-8ffc-b9d86c60f951 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1218 microversion: 2.1 time: 0.065868 Jan 15 16:22:17.590480 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 932/1906] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:17 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:18.606728 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-37126ff8-4b15-4065-a1f7-f791caeb70f3 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:18.607345 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-37126ff8-4b15-4065-a1f7-f791caeb70f3 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:18.663451 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-37126ff8-4b15-4065-a1f7-f791caeb70f3 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:18.669943 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-37126ff8-4b15-4065-a1f7-f791caeb70f3 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1218 microversion: 2.1 time: 0.066916 Jan 15 16:22:18.670504 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 975/1907] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:18 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:19.686647 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:19.687537 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:19.694588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:19.695091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:19.695869 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:19.696336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:19.754244 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:19.761285 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-898c20bc-3e43-4b4e-ac90-3fbe7c587e00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1222 microversion: 2.1 time: 0.078401 Jan 15 16:22:19.761843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 933/1908] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:19 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:20.777560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:20.778226 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:20.785367 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:20.785819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:20.786604 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:20.787045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:20.846839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:20.854148 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2ca83ada-d74a-4023-b429-9c9246c9e30d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1222 microversion: 2.1 time: 0.080348 Jan 15 16:22:20.854700 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 976/1909] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:20 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:22:21.872059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:21.872059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:21.879296 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:21.879808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:21.880779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:21.881223 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:21.941863 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:21.949215 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b0dbf76d-8e8a-4e00-915e-d71fbf7351bb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1276 microversion: 2.1 time: 0.081830 Jan 15 16:22:21.949789 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 934/1910] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:21 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1276 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:22.966862 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:22.967524 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:22.973880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:22.974339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:22.975116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:22.975547 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:23.110678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:23.119288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a1a61106-3f66-40f7-a588-7c942a690802 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1318 microversion: 2.1 time: 0.155994 Jan 15 16:22:23.119782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 977/1911] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:22 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:23.388113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-07e855ba-0d21-45e4-abff-547649120043 req-67e965c1-0762-471c-bd06-395ffbbd9992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc5edbb-89ba-4f33-93e0-ac1bc3b74019", "tag": "c7457ca3-7592-4fe3-8b18-0c136409a485"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:22:23.389804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:22:23.389804 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:22:23.396835 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-07e855ba-0d21-45e4-abff-547649120043 req-67e965c1-0762-471c-bd06-395ffbbd9992 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:23.397287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-07e855ba-0d21-45e4-abff-547649120043 req-67e965c1-0762-471c-bd06-395ffbbd9992 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:23.408740 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-07e855ba-0d21-45e4-abff-547649120043 req-67e965c1-0762-471c-bd06-395ffbbd9992 service nova] Creating event network-changed:c7457ca3-7592-4fe3-8b18-0c136409a485 for instance 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 on hv-cinder-82481 Jan 15 16:22:23.414749 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-07e855ba-0d21-45e4-abff-547649120043 req-67e965c1-0762-471c-bd06-395ffbbd9992 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030147 Jan 15 16:22:23.415344 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 935/1912] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:22:24.136513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:24.137169 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:24.144976 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:24.145433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:24.146225 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:24.146684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:24.274087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:24.282133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0fbeaaa1-c003-4fbc-9531-36478154b922 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1318 microversion: 2.1 time: 0.149561 Jan 15 16:22:24.282742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 978/1913] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:24 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:25.299743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:25.300406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:25.306497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:25.306950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:25.307728 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:25.308280 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:25.436044 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:25.443485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a1be13ec-93fc-4440-b222-2ff01e5091fa tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1318 microversion: 2.1 time: 0.148428 Jan 15 16:22:25.444066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 936/1914] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:25 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:26.460717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:26.461239 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:26.467471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:26.468523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:26.469517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:26.469949 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:26.602781 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:26.611070 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8cb8665a-e368-408f-8495-662e28acb475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1318 microversion: 2.1 time: 0.154058 Jan 15 16:22:26.611656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 979/1915] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:26 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:27.629007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:27.629649 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:27.635941 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:27.636419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:27.637196 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:27.637636 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:27.765664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:27.772743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6faa3249-6ef4-4603-a1f2-86a8c8846148 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1318 microversion: 2.1 time: 0.147548 Jan 15 16:22:27.773306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 937/1916] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:27 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:28.792308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:28.792308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:28.797184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:28.797621 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:28.798412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:28.798860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:28.843353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-265622bb-7a73-490f-9cc4-967d965c500a req-0fc72ded-f107-4477-b8da-3eb7f77ab48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc5edbb-89ba-4f33-93e0-ac1bc3b74019", "name": "network-vif-plugged", "status": "completed", "tag": "c7457ca3-7592-4fe3-8b18-0c136409a485"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:22:28.843353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:22:28.843353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:22:28.849699 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-265622bb-7a73-490f-9cc4-967d965c500a req-0fc72ded-f107-4477-b8da-3eb7f77ab48a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:28.850145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-265622bb-7a73-490f-9cc4-967d965c500a req-0fc72ded-f107-4477-b8da-3eb7f77ab48a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:28.861105 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-265622bb-7a73-490f-9cc4-967d965c500a req-0fc72ded-f107-4477-b8da-3eb7f77ab48a service nova] Creating event network-vif-plugged:c7457ca3-7592-4fe3-8b18-0c136409a485 for instance 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 on hv-cinder-82481 Jan 15 16:22:28.867853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-265622bb-7a73-490f-9cc4-967d965c500a req-0fc72ded-f107-4477-b8da-3eb7f77ab48a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084489 Jan 15 16:22:28.868641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 980/1917] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:22:28.945486 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:28.954065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d8bca1ab-d069-4381-bf29-3114683b9f5e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1318 microversion: 2.1 time: 0.168812 Jan 15 16:22:28.954640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 938/1918] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:28 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:22:29.971092 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:29.971796 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:29.978291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:29.978739 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:29.979517 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:29.979954 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:30.112240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:30.119694 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-41811cc5-f5a1-4e4a-b444-024cb3a2f2e9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1318 microversion: 2.1 time: 0.152745 Jan 15 16:22:30.120291 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 981/1919] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:29 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:22:31.135884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:22:31.136533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:22:31.142938 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:31.143387 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:31.144187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:22:31.144626 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:22:31.272651 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:22:31.279829 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7014ef7d-94a8-4ef5-beeb-03ec05179254 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1508 microversion: 2.1 time: 0.147615 Jan 15 16:22:31.280497 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 939/1920] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:22:31 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:08.270428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4311efde-666e-4f7d-a1b0-261132ac45a8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43df8593-deae-4713-abfb-33193652c46c"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:08.271844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4311efde-666e-4f7d-a1b0-261132ac45a8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:08.280266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4311efde-666e-4f7d-a1b0-261132ac45a8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:08.280775 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4311efde-666e-4f7d-a1b0-261132ac45a8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:08.282572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4311efde-666e-4f7d-a1b0-261132ac45a8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:08.283113 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4311efde-666e-4f7d-a1b0-261132ac45a8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:09.013029 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4311efde-666e-4f7d-a1b0-261132ac45a8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748194 Jan 15 16:23:09.023276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 982/1921] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 16:23:08 2022] POST /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments => generated 194 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:23:17.706063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:23:17.707191 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:23:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:23:29.174784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-40524761", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "3565f3df-734a-4e0c-b759-c2ee7a743d66"}]}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:29.225739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.network.neutron [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] validate_networks() for [('3565f3df-734a-4e0c-b759-c2ee7a743d66', None, None, None, None, None)] {{(pid=123221) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 16:23:29.681357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 16:23:29.681781 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 16:23:29.682256 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 16:23:29.682665 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 16:23:29.683077 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 16:23:29.691878 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:29.692361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:29.693184 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:29.693623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:29.710461 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:23:29.714382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for user 13df32b632904102baf80323020194b1 and project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:23:29.725428 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Going to run 1 instances... {{(pid=123221) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 16:23:29.737273 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 16:23:29.855778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-cc1b60c2-d991-49d1-90dc-041b20a68934 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684836 Jan 15 16:23:29.856561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 940/1922] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 16:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 16:23:29.867751 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ac8c06eb-6e78-4536-b92a-2a58bb2b9eed tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:29.868583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ac8c06eb-6e78-4536-b92a-2a58bb2b9eed tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:29.922108 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ac8c06eb-6e78-4536-b92a-2a58bb2b9eed tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:29.929199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ac8c06eb-6e78-4536-b92a-2a58bb2b9eed tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1216 microversion: 2.1 time: 0.066441 Jan 15 16:23:29.929780 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 983/1923] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:29 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:30.946966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:30.947674 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:30.953982 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:30.954457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:30.955242 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:30.955677 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:31.024919 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:31.032194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-17a7e751-3147-4395-b79f-338337718a6e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1212 microversion: 2.1 time: 0.089481 Jan 15 16:23:31.038720 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 941/1924] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:30 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:23:32.051095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:32.052623 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:32.059860 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:32.060346 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:32.061143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:32.061580 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:32.126310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:32.135108 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0ac2c981-3fff-4466-a6cc-ab3da779cf38 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1286 microversion: 2.1 time: 0.088245 Jan 15 16:23:32.135684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 984/1925] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:32 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:33.152122 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:33.152766 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:33.162309 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:33.162765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:33.163563 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:33.164007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:33.294572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:33.302287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0dab0421-a663-4514-a239-197337775909 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1316 microversion: 2.1 time: 0.153941 Jan 15 16:23:33.302845 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 942/1926] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:33 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:33.586133 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-5a6df8ba-cc91-4849-be38-54b2b80eb6a1 req-656c9bda-d1dc-4605-a0b8-c028f6f7a677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5517638-6ee9-476d-bfb7-8fd432df1b7e", "tag": "8ba4350b-66c4-4f7b-9512-7fc6767175ee"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:33.593849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:23:33.593849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:23:33.594599 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-5a6df8ba-cc91-4849-be38-54b2b80eb6a1 req-656c9bda-d1dc-4605-a0b8-c028f6f7a677 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:33.595037 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-5a6df8ba-cc91-4849-be38-54b2b80eb6a1 req-656c9bda-d1dc-4605-a0b8-c028f6f7a677 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:33.605534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-5a6df8ba-cc91-4849-be38-54b2b80eb6a1 req-656c9bda-d1dc-4605-a0b8-c028f6f7a677 service nova] Creating event network-changed:8ba4350b-66c4-4f7b-9512-7fc6767175ee for instance d5517638-6ee9-476d-bfb7-8fd432df1b7e on hv-cinder-82481 Jan 15 16:23:33.610151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-5a6df8ba-cc91-4849-be38-54b2b80eb6a1 req-656c9bda-d1dc-4605-a0b8-c028f6f7a677 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144669 Jan 15 16:23:33.610905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 985/1927] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:23:33.865160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:23:33.865331 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:23:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:23:34.318623 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:34.319442 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:34.325445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:34.325888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:34.326668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:34.327099 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:34.457608 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:34.464767 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-91e13cac-0013-495a-9666-575887e3928f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1316 microversion: 2.1 time: 0.149945 Jan 15 16:23:34.465323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 943/1928] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:34 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:35.483632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:35.484370 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:35.490732 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:35.491158 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:35.491938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:35.492405 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:35.624988 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:35.633055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c2f251e7-3b12-45dd-b096-5fe5c54014ad tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1316 microversion: 2.1 time: 0.154006 Jan 15 16:23:35.633628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 986/1929] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:35 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:36.650158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:36.650771 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:36.657188 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:36.657640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:36.658418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:36.658853 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:36.789605 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:36.796884 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b582079c-981c-4fa6-9fd4-1c26896fe48a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1316 microversion: 2.1 time: 0.150375 Jan 15 16:23:36.797441 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 944/1930] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:36 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:37.813040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:37.813657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:37.819977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:37.820473 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:37.821256 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:37.821692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:37.960216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:37.967518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-dd2d8d66-a975-40d0-9059-5af880bb347f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1316 microversion: 2.1 time: 0.158118 Jan 15 16:23:37.968079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 987/1931] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:37 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:38.984827 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:38.985446 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:38.992526 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:38.992975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:38.993964 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:38.994230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:39.134071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:39.134071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-a7af4deb-4020-4ef4-8518-76e2f7057090 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1316 microversion: 2.1 time: 0.151962 Jan 15 16:23:39.134071 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 945/1932] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:38 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:39.233558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-837feedc-5694-4e19-b5db-a512ed93575f req-12a8f366-af56-471a-937c-11b721cd3467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5517638-6ee9-476d-bfb7-8fd432df1b7e", "name": "network-vif-plugged", "status": "completed", "tag": "8ba4350b-66c4-4f7b-9512-7fc6767175ee"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:39.235086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:23:39.235086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:23:39.242948 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-837feedc-5694-4e19-b5db-a512ed93575f req-12a8f366-af56-471a-937c-11b721cd3467 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:39.243397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-837feedc-5694-4e19-b5db-a512ed93575f req-12a8f366-af56-471a-937c-11b721cd3467 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:39.254607 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-837feedc-5694-4e19-b5db-a512ed93575f req-12a8f366-af56-471a-937c-11b721cd3467 service nova] Creating event network-vif-plugged:8ba4350b-66c4-4f7b-9512-7fc6767175ee for instance d5517638-6ee9-476d-bfb7-8fd432df1b7e on hv-cinder-82481 Jan 15 16:23:39.260393 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-837feedc-5694-4e19-b5db-a512ed93575f req-12a8f366-af56-471a-937c-11b721cd3467 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030311 Jan 15 16:23:39.260982 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 988/1933] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:23:40.150274 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:40.150891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:40.157185 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:40.157634 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:40.158456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:40.158909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:40.333501 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:40.340929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-99823920-3095-41fe-923d-8ad0ffa3499d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1316 microversion: 2.1 time: 0.194479 Jan 15 16:23:40.341577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 946/1934] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:40 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:41.358978 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:41.359808 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:41.367688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.368165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:41.369569 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.370244 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:41.513235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:41.521163 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-56686f18-a6f1-417c-9ceb-b0ad1db4a457 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1505 microversion: 2.1 time: 0.166588 Jan 15 16:23:41.521739 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 989/1935] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:41 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:41.538413 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43df8593-deae-4713-abfb-33193652c46c"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:41.539517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:41.545445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.546091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:41.546872 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.547351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:41.629914 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] HTTP exception thrown: Invalid volume: volume 43df8593-deae-4713-abfb-33193652c46c is already attached to instances: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 Jan 15 16:23:41.630433 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Returning 400 to user: Invalid volume: volume 43df8593-deae-4713-abfb-33193652c46c is already attached to instances: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:23:41.631281 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ad34883d-72be-4014-891f-c6e238a4a60c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097587 Jan 15 16:23:41.631843 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 947/1936] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 16:23:41 2022] POST /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:23:41.688649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:41.689143 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:41.694944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.695391 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:41.696222 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.696655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:41.773856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lazy-loading 'services' on Instance uuid 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:23:41.967218 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0483cbfd-978a-43cf-a23a-a8d0f6727777 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments/43df8593-deae-4713-abfb-33193652c46c" status: 202 len: 0 microversion: 2.1 time: 0.282066 Jan 15 16:23:41.967915 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 990/1937] 10.222.0.36 () {58 vars in 1415 bytes} [Sat Jan 15 16:23:41 2022] DELETE /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments/43df8593-deae-4713-abfb-33193652c46c => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:23:41.976668 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3d488e0f-c353-4b83-8a84-3c913de7ba46 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:41.977595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3d488e0f-c353-4b83-8a84-3c913de7ba46 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:41.984554 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d488e0f-c353-4b83-8a84-3c913de7ba46 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.984927 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d488e0f-c353-4b83-8a84-3c913de7ba46 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:41.985722 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d488e0f-c353-4b83-8a84-3c913de7ba46 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:41.986264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d488e0f-c353-4b83-8a84-3c913de7ba46 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:42.017716 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3d488e0f-c353-4b83-8a84-3c913de7ba46 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Jan 15 16:23:42.018225 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 948/1938] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:23:41 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:23:43.029969 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0361edfb-1555-48ed-8773-e5fbac2e4505 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:43.031059 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0361edfb-1555-48ed-8773-e5fbac2e4505 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:43.038590 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0361edfb-1555-48ed-8773-e5fbac2e4505 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:43.039040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0361edfb-1555-48ed-8773-e5fbac2e4505 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:43.039939 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0361edfb-1555-48ed-8773-e5fbac2e4505 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:43.040433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0361edfb-1555-48ed-8773-e5fbac2e4505 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:43.071535 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0361edfb-1555-48ed-8773-e5fbac2e4505 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045697 Jan 15 16:23:43.074602 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 991/1939] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:23:43 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:23:44.085961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-37fe2000-8027-4a49-8fc8-db515284b9d2 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:44.086918 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-37fe2000-8027-4a49-8fc8-db515284b9d2 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:44.093358 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37fe2000-8027-4a49-8fc8-db515284b9d2 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:44.093808 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37fe2000-8027-4a49-8fc8-db515284b9d2 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:44.094587 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37fe2000-8027-4a49-8fc8-db515284b9d2 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:44.095024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-37fe2000-8027-4a49-8fc8-db515284b9d2 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:44.123995 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-37fe2000-8027-4a49-8fc8-db515284b9d2 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042228 Jan 15 16:23:44.124502 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 949/1940] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:23:44 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 16:23:44.281884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2029607518", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "3565f3df-734a-4e0c-b759-c2ee7a743d66"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:44.334182 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] validate_networks() for [('3565f3df-734a-4e0c-b759-c2ee7a743d66', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 16:23:45.002206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 16:23:45.002712 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 16:23:45.003621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 16:23:45.005300 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 16:23:45.007381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 16:23:45.019266 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:45.021630 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:45.023045 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:45.023659 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:45.050170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:23:45.056579 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for user 13df32b632904102baf80323020194b1 and project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:23:45.074703 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 16:23:45.077935 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 16:23:45.232383 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8ddc4084-6c36-44c3-ac02-5458e1e78908 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954048 Jan 15 16:23:45.237987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 992/1941] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 16:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 16:23:45.243890 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-06e442ff-a077-47b8-9d4b-b6f045b1e342 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:45.245191 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-06e442ff-a077-47b8-9d4b-b6f045b1e342 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:45.303760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-06e442ff-a077-47b8-9d4b-b6f045b1e342 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:45.313153 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-06e442ff-a077-47b8-9d4b-b6f045b1e342 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1218 microversion: 2.1 time: 0.072908 Jan 15 16:23:45.313921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 950/1942] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:45 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:46.330844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:46.332116 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:46.338808 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:46.339449 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:46.340292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:46.341152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:46.436294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:46.443993 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0b7d9c6c-501c-4422-9da9-2bd3281b7df4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1222 microversion: 2.1 time: 0.117321 Jan 15 16:23:46.444823 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 993/1943] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:46 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:47.460788 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:47.461397 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:47.475200 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:47.475817 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:47.476842 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:47.477729 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:47.562756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:47.571807 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-02bad6b0-cdd6-4cde-abab-4b0c33e33f8c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1278 microversion: 2.1 time: 0.115053 Jan 15 16:23:47.580183 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 951/1944] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:47 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:48.595333 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:48.595955 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:48.602983 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:48.603715 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:48.604765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:48.605378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:48.701162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:48.709546 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-df2b4c32-6e09-4e84-a7c2-72c6017b484f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1276 microversion: 2.1 time: 0.117775 Jan 15 16:23:48.710880 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 994/1945] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:48 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:49.727764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:49.729093 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:49.739906 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:49.741295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:49.741737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:49.742180 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:49.946032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:49.955036 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0ad69a4a-09bd-4443-9981-2a01e610b14b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1318 microversion: 2.1 time: 0.231121 Jan 15 16:23:49.955653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 952/1946] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:49 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:50.483377 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-dde63d9c-0cf4-45c7-bc27-3919deb09700 req-5d53e374-c37e-48e1-a178-61c5cbfbb12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c783e66e-097b-4cbd-884c-2ecf3a8b2de0", "tag": "aab8845d-2098-45c8-b97b-a8cfb3e7bacb"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:50.485043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:23:50.485043 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:23:50.494131 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-dde63d9c-0cf4-45c7-bc27-3919deb09700 req-5d53e374-c37e-48e1-a178-61c5cbfbb12e service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:50.494834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-dde63d9c-0cf4-45c7-bc27-3919deb09700 req-5d53e374-c37e-48e1-a178-61c5cbfbb12e service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:50.507276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-dde63d9c-0cf4-45c7-bc27-3919deb09700 req-5d53e374-c37e-48e1-a178-61c5cbfbb12e service nova] Creating event network-changed:aab8845d-2098-45c8-b97b-a8cfb3e7bacb for instance c783e66e-097b-4cbd-884c-2ecf3a8b2de0 on hv-cinder-82481 Jan 15 16:23:50.513198 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-dde63d9c-0cf4-45c7-bc27-3919deb09700 req-5d53e374-c37e-48e1-a178-61c5cbfbb12e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034251 Jan 15 16:23:50.515361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 995/1947] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:23:50.972499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:50.973801 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:50.980454 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:50.981010 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:50.981969 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:50.982506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:51.184772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:51.194572 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5f04b1ab-f8be-4067-bbbd-291c1db3921a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1318 microversion: 2.1 time: 0.225875 Jan 15 16:23:51.203866 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 953/1948] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:50 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:52.212759 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:52.213462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:52.220892 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:52.221336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:52.222121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:52.223593 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:52.384944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:52.393049 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5f4dc82f-edc6-4e04-a59b-eaa7aef016b4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1318 microversion: 2.1 time: 0.185756 Jan 15 16:23:52.395432 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 996/1949] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:52 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:53.412069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:53.412662 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:53.420595 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:53.426713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:53.426713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:53.426713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:53.581419 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:53.589314 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-aaabe497-028e-4a1c-a71e-94b0b4ac9557 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1318 microversion: 2.1 time: 0.182328 Jan 15 16:23:53.589985 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 954/1950] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:53 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:54.608482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:54.609836 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:54.618453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:54.619215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:54.621510 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:54.622192 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:54.761735 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:54.769096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8aae6c8a-d5db-48e5-9638-8053e6ca8475 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1318 microversion: 2.1 time: 0.166218 Jan 15 16:23:54.769883 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 997/1951] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:54 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:55.658861 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-566e35f0-6b20-4a9a-8137-895675554f3e req-51017aae-06d8-42c6-a836-6395df845c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c783e66e-097b-4cbd-884c-2ecf3a8b2de0", "name": "network-vif-plugged", "status": "completed", "tag": "aab8845d-2098-45c8-b97b-a8cfb3e7bacb"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:55.661921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:23:55.661921 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:23:55.669687 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-566e35f0-6b20-4a9a-8137-895675554f3e req-51017aae-06d8-42c6-a836-6395df845c16 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:55.670239 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-566e35f0-6b20-4a9a-8137-895675554f3e req-51017aae-06d8-42c6-a836-6395df845c16 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:55.682348 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-566e35f0-6b20-4a9a-8137-895675554f3e req-51017aae-06d8-42c6-a836-6395df845c16 service nova] Creating event network-vif-plugged:aab8845d-2098-45c8-b97b-a8cfb3e7bacb for instance c783e66e-097b-4cbd-884c-2ecf3a8b2de0 on hv-cinder-82481 Jan 15 16:23:55.688505 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-566e35f0-6b20-4a9a-8137-895675554f3e req-51017aae-06d8-42c6-a836-6395df845c16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032934 Jan 15 16:23:55.689182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 955/1952] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:23:55.788090 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:55.790633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:55.805680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:55.805680 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:55.806386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:55.807310 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:55.997443 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:56.006027 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c86ccfe3-1acf-46b6-8d86-97114302e8cb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1318 microversion: 2.1 time: 0.223193 Jan 15 16:23:56.016454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 998/1953] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:55 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:23:57.023063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:57.024453 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:57.031820 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:57.037636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:57.037636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:57.037636 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:57.133940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Action: 'create', calling method: .version_select at 0x7f216c969c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1871994652"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:23:57.148864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Getting quotas for project 059ecd33a4c34286a4eff635782704bd. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:23:57.152959 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Getting quotas for user c21745b7e41746f89af5e9130dbb8695 and project 059ecd33a4c34286a4eff635782704bd. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:23:57.165790 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [df113b5c-d3eb-4792-b13a-6d7c248fe5fc] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:23:57.179628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:57.187112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-9cd91184-1e9f-4859-9790-c137f78e4274 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1318 microversion: 2.1 time: 0.168337 Jan 15 16:23:57.187678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 999/1954] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:57 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:23:58.173289 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [df113b5c-d3eb-4792-b13a-6d7c248fe5fc] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43258. Jan 15 16:23:58.203638 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:23:58.204406 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:23:58.211806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:58.212314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:58.213445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:23:58.213885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:23:58.352335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:23:58.359576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c8bcd92d-c7df-4e44-8ccd-fc37b29602eb tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1507 microversion: 2.1 time: 0.159604 Jan 15 16:23:58.360162 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1000/1955] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:23:58 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:23:58.441186 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Getting quotas for project 059ecd33a4c34286a4eff635782704bd. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:23:58.447951 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Getting quotas for user c21745b7e41746f89af5e9130dbb8695 and project 059ecd33a4c34286a4eff635782704bd. Resources: {'key_pairs'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:23:58.461357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0c4e7227-c511-4c8f-8be3-d4cc2ee636fe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.515934 Jan 15 16:23:58.462017 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 956/1956] 10.222.0.36 () {60 vars in 1157 bytes} [Sat Jan 15 16:23:56 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:00.048250 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e934e281-818c-4722-aaaf-2d2dfdf7bb5c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3db36b0-4798-46d9-b7aa-82d40c8c94ec"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:00.049153 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e934e281-818c-4722-aaaf-2d2dfdf7bb5c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:00.055622 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e934e281-818c-4722-aaaf-2d2dfdf7bb5c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:00.056222 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e934e281-818c-4722-aaaf-2d2dfdf7bb5c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:00.057151 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e934e281-818c-4722-aaaf-2d2dfdf7bb5c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:00.057692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e934e281-818c-4722-aaaf-2d2dfdf7bb5c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:01.023525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e934e281-818c-4722-aaaf-2d2dfdf7bb5c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.979221 Jan 15 16:24:01.024589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1001/1957] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 16:24:00 2022] POST /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments => generated 194 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:24:09.564334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3db36b0-4798-46d9-b7aa-82d40c8c94ec"}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:09.565493 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:09.572356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:09.572879 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:09.578826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:09.578826 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:09.655779 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] HTTP exception thrown: Invalid volume: volume f3db36b0-4798-46d9-b7aa-82d40c8c94ec is already attached to instances: c783e66e-097b-4cbd-884c-2ecf3a8b2de0 Jan 15 16:24:09.656436 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Returning 400 to user: Invalid volume: volume f3db36b0-4798-46d9-b7aa-82d40c8c94ec is already attached to instances: c783e66e-097b-4cbd-884c-2ecf3a8b2de0 {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:24:09.657277 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-8f285aba-3570-4290-b103-6a9f6d3ddd1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097370 Jan 15 16:24:09.657815 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 957/1958] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 16:24:09 2022] POST /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 16:24:09.715902 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:09.716511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:09.722594 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:09.723047 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:09.723828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:09.724309 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:09.800795 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lazy-loading 'services' on Instance uuid c783e66e-097b-4cbd-884c-2ecf3a8b2de0 {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:24:09.995087 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4cf834da-1702-4bcd-8809-d9a49ef7a15c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments/f3db36b0-4798-46d9-b7aa-82d40c8c94ec" status: 202 len: 0 microversion: 2.1 time: 0.284149 Jan 15 16:24:09.995662 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1002/1959] 10.222.0.36 () {58 vars in 1415 bytes} [Sat Jan 15 16:24:09 2022] DELETE /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments/f3db36b0-4798-46d9-b7aa-82d40c8c94ec => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:24:10.003577 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-dbf4e1f6-e121-4c38-b2d8-d20ec606c54a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:10.004555 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-dbf4e1f6-e121-4c38-b2d8-d20ec606c54a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:10.011131 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dbf4e1f6-e121-4c38-b2d8-d20ec606c54a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:10.011578 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dbf4e1f6-e121-4c38-b2d8-d20ec606c54a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:10.012394 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dbf4e1f6-e121-4c38-b2d8-d20ec606c54a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:10.012850 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-dbf4e1f6-e121-4c38-b2d8-d20ec606c54a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:10.044929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-dbf4e1f6-e121-4c38-b2d8-d20ec606c54a tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Jan 15 16:24:10.045232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 958/1960] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:24:09 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:11.056678 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f6f396a8-d39c-43a7-bbc1-31d9f4d5eb3c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:11.057769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f6f396a8-d39c-43a7-bbc1-31d9f4d5eb3c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:11.063822 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6f396a8-d39c-43a7-bbc1-31d9f4d5eb3c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:11.064316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6f396a8-d39c-43a7-bbc1-31d9f4d5eb3c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:11.065089 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6f396a8-d39c-43a7-bbc1-31d9f4d5eb3c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:11.065527 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f6f396a8-d39c-43a7-bbc1-31d9f4d5eb3c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:11.097350 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f6f396a8-d39c-43a7-bbc1-31d9f4d5eb3c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Jan 15 16:24:11.097917 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1003/1961] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:24:11 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:12.109660 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4572432e-587b-42f4-ba23-fadd16127650 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:12.110652 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4572432e-587b-42f4-ba23-fadd16127650 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:12.117265 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4572432e-587b-42f4-ba23-fadd16127650 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:12.117661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4572432e-587b-42f4-ba23-fadd16127650 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:12.118456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4572432e-587b-42f4-ba23-fadd16127650 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:12.118903 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4572432e-587b-42f4-ba23-fadd16127650 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:12.147660 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4572432e-587b-42f4-ba23-fadd16127650 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041844 Jan 15 16:24:12.148232 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 959/1962] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:24:12 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 16:24:12.294254 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-542171673", "imageRef": "2e4ad1d4-98be-43b3-ad85-3c165e9aa43b", "flavorRef": "452", "networks": [{"uuid": "3565f3df-734a-4e0c-b759-c2ee7a743d66"}]}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:12.346240 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.network.neutron [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] validate_networks() for [('3565f3df-734a-4e0c-b759-c2ee7a743d66', None, None, None, None, None)] {{(pid=123220) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 16:24:12.717742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 16:24:12.718185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image limits 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 16:24:12.718656 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Flavor pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 16:24:12.719104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Image pref 0:0:0 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 16:24:12.719534 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.virt.hardware [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 16:24:12.727970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:12.728468 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:12.729288 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:12.729711 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:12.745772 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:24:12.749641 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.quota [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Getting quotas for user 13df32b632904102baf80323020194b1 and project f3eacc08c2974c51a483628551748c81. Resources: {'cores', 'instances', 'ram'} {{(pid=123220) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:24:12.759956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Going to run 1 instances... {{(pid=123220) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 16:24:12.762907 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e4ad1d4-98be-43b3-ad85-3c165e9aa43b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 16:24:12.854558 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f9149d3c-8e68-49fa-a87b-524110f306b0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564703 Jan 15 16:24:12.855179 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1004/1963] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 16:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 16:24:12.865217 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-57b19008-dfe6-4b58-ab6a-5f8cca9473d7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:12.865834 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-57b19008-dfe6-4b58-ab6a-5f8cca9473d7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:12.921517 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-57b19008-dfe6-4b58-ab6a-5f8cca9473d7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:12.928000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-57b19008-dfe6-4b58-ab6a-5f8cca9473d7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1217 microversion: 2.1 time: 0.066828 Jan 15 16:24:12.928638 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 960/1964] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:12 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:13.945573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:13.946187 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:13.953573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:13.954029 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:13.954812 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:13.955249 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:14.013933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:14.021206 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8e623ca4-b461-4649-8b40-4e0f7ba3c3cc tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1221 microversion: 2.1 time: 0.079762 Jan 15 16:24:14.021814 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1005/1965] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:13 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:15.037539 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:15.038162 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:15.045975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:15.046361 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:15.047372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:15.047971 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:15.112986 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:15.120913 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5deb85df-a895-4b1d-9072-5489d59a5a82 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1275 microversion: 2.1 time: 0.086573 Jan 15 16:24:15.121698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 961/1966] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:15 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:16.138523 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:16.139154 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:16.145413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:16.145871 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:16.153994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:16.153994 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:16.279284 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:16.286392 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e2008bb5-4b8c-4cdc-9fa6-b6af3907a55d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.152338 Jan 15 16:24:16.286949 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1006/1967] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:16 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:16.405147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-87f539b3-d16a-40c9-9cac-707e6f63292d req-ca2c112f-27c8-4d31-a41c-43ac69d49122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a", "tag": "af235e27-aeec-4770-a434-69daab17d4fc"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:16.407310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:16.407310 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:24:16.414457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-87f539b3-d16a-40c9-9cac-707e6f63292d req-ca2c112f-27c8-4d31-a41c-43ac69d49122 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:16.415449 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-87f539b3-d16a-40c9-9cac-707e6f63292d req-ca2c112f-27c8-4d31-a41c-43ac69d49122 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:16.426356 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-87f539b3-d16a-40c9-9cac-707e6f63292d req-ca2c112f-27c8-4d31-a41c-43ac69d49122 service nova] Creating event network-changed:af235e27-aeec-4770-a434-69daab17d4fc for instance 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a on hv-cinder-82481 Jan 15 16:24:16.431260 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-87f539b3-d16a-40c9-9cac-707e6f63292d req-ca2c112f-27c8-4d31-a41c-43ac69d49122 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029911 Jan 15 16:24:16.431844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 962/1968] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:17.303573 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:17.304225 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:17.310748 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:17.311199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:17.311984 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:17.312460 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:17.459632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:17.467542 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c220c0e7-359c-4a87-aa9d-e55a51a32c57 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.167629 Jan 15 16:24:17.470472 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1007/1969] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:17 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:18.486585 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:18.487715 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:18.493793 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:18.494247 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:18.495124 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:18.495561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:18.624967 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:18.632090 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d1b4e456-b72a-45a6-a343-262a1bdc0f1c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.149995 Jan 15 16:24:18.632682 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 963/1970] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:18 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:19.648980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:19.649588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:19.656511 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:19.656960 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:19.657731 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:19.658166 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:19.787514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:19.795752 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4bc5235c-fe8f-4ccf-9e9a-bdf00c149c00 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.150455 Jan 15 16:24:19.796326 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1008/1971] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:19 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:20.812704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:20.813332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:20.819619 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:20.820066 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:20.820864 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:20.821297 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:20.953086 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:20.960203 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ad839839-cb17-4406-b9eb-f05cd2a07a2d tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.151497 Jan 15 16:24:20.960757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 964/1972] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:20 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:21.977509 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:21.978305 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:21.985170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:21.985619 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:21.986396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:21.986834 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:22.114989 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:22.122156 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8ea7d97e-6945-4883-8289-a47928255758 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.148221 Jan 15 16:24:22.122654 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1009/1973] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:21 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:22.965862 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-522522572", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1871994652", "security_groups": [{"name": "tempest-secgroup-smoke-1877411148"}], "networks": [{"uuid": "17522dcc-d194-45c0-bdcd-0d054c80663a"}], "block_device_mapping_v2": [{"uuid": "8aa26196-1967-4e5c-a5ae-94a58e8a44cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:23.077594 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.network.neutron [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] validate_networks() for [('17522dcc-d194-45c0-bdcd-0d054c80663a', None, None, None, None, None)] {{(pid=123221) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 16:24:23.138746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:23.139399 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:23.145670 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:23.146135 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:23.146927 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:23.147373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:23.593819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:23.600959 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4f02b6d8-144a-4f12-a73a-1c2a048b2a8e tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.466201 Jan 15 16:24:23.601515 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1010/1974] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:23 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:24:23.605839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-501134f6-d897-4a03-bbc9-3f51ba1b6dfa req-c572b93e-a75a-49e6-b7e1-d3a5f00bec0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a", "name": "network-vif-plugged", "status": "completed", "tag": "af235e27-aeec-4770-a434-69daab17d4fc"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:23.607505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:23.607505 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:24:23.614292 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-501134f6-d897-4a03-bbc9-3f51ba1b6dfa req-c572b93e-a75a-49e6-b7e1-d3a5f00bec0d service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:23.614740 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-501134f6-d897-4a03-bbc9-3f51ba1b6dfa req-c572b93e-a75a-49e6-b7e1-d3a5f00bec0d service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:23.625811 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-501134f6-d897-4a03-bbc9-3f51ba1b6dfa req-c572b93e-a75a-49e6-b7e1-d3a5f00bec0d service nova] Creating event network-vif-plugged:af235e27-aeec-4770-a434-69daab17d4fc for instance 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a on hv-cinder-82481 Jan 15 16:24:23.630725 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-501134f6-d897-4a03-bbc9-3f51ba1b6dfa req-c572b93e-a75a-49e6-b7e1-d3a5f00bec0d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028121 Jan 15 16:24:23.631299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1011/1975] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:23.729018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Flavor limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 16:24:23.729448 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Image limits 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 16:24:23.729925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Flavor pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 16:24:23.730336 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Image pref 0:0:0 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 16:24:23.731332 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.virt.hardware [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 16:24:23.740111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:23.740538 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:23.741351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:23.741837 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:23.758491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Getting quotas for project 059ecd33a4c34286a4eff635782704bd. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 16:24:23.762401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.quota [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Getting quotas for user c21745b7e41746f89af5e9130dbb8695 and project 059ecd33a4c34286a4eff635782704bd. Resources: {'cores', 'instances', 'ram'} {{(pid=123221) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 16:24:23.816784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Going to run 1 instances... {{(pid=123221) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 16:24:23.818966 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8aa26196-1967-4e5c-a5ae-94a58e8a44cb',volume_size=None,volume_type=None)] {{(pid=123221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 16:24:24.184751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3f6e6a72-4b4b-4dfb-8ee2-a8c72fd1bba2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.222847 Jan 15 16:24:24.185438 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 965/1976] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Jan 15 16:24:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 16:24:24.196413 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-3c91a941-3afa-4030-9c4e-57b0cd286e1a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:24.197118 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-3c91a941-3afa-4030-9c4e-57b0cd286e1a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:24.249934 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-3c91a941-3afa-4030-9c4e-57b0cd286e1a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:24.256442 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-3c91a941-3afa-4030-9c4e-57b0cd286e1a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1088 microversion: 2.1 time: 0.064700 Jan 15 16:24:24.257068 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1012/1977] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:24 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:24.618079 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:24.618726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:24.625499 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:24.626005 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:24.626785 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:24.627295 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:24.763163 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:24.770347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-12b27787-6f52-4faf-bcf1-94cdf6320cc9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1317 microversion: 2.1 time: 0.156062 Jan 15 16:24:24.770908 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 966/1978] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:24 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:25.273295 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:25.274040 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:25.281765 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:25.282214 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:25.283052 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:25.283487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:25.342622 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:25.350155 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c1af21f5-55f2-452a-b01e-2dee1f413ee8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1138 microversion: 2.1 time: 0.080481 Jan 15 16:24:25.350944 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1013/1979] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:25 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:24:25.787699 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:25.788266 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:25.795681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:25.796133 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:25.796929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:25.797365 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:25.925073 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:25.932276 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-68f0a97b-a93e-4715-85a9-00b6ef154530 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1506 microversion: 2.1 time: 0.148356 Jan 15 16:24:25.932840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 967/1980] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:25 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:26.366793 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:26.367390 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:26.373771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:26.377596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:26.377596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:26.377596 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:26.439949 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:26.447864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4bd27988-8e0f-405a-b825-546a5374739c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1194 microversion: 2.1 time: 0.084696 Jan 15 16:24:26.448545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1014/1981] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:26 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:27.470686 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:27.471286 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:27.477656 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:27.478105 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:27.478925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:27.479359 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:27.545787 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5d39c59b-adb6-4572-a2cb-10054b70f4e0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9812b444-ebcb-40a6-8673-334d6666dd0e"}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:27.547216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5d39c59b-adb6-4572-a2cb-10054b70f4e0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:27.556264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5d39c59b-adb6-4572-a2cb-10054b70f4e0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:27.556875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5d39c59b-adb6-4572-a2cb-10054b70f4e0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:27.557727 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5d39c59b-adb6-4572-a2cb-10054b70f4e0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:27.558165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5d39c59b-adb6-4572-a2cb-10054b70f4e0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:27.634170 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:27.662681 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9efcb82a-2709-46d0-b872-2780090fa29e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1272 microversion: 2.1 time: 0.195513 Jan 15 16:24:27.664701 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 968/1982] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:27 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:24:27.946341 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-72bb87e3-25b0-4fc5-b4b5-8760debb7e9a req-82009921-2a65-47cb-af02-1e90cb02fd9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d7d294-5cc6-4500-9845-3ce118d36e6f", "tag": "3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:27.948900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:27.948900 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:24:27.956944 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-72bb87e3-25b0-4fc5-b4b5-8760debb7e9a req-82009921-2a65-47cb-af02-1e90cb02fd9a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:27.957431 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-72bb87e3-25b0-4fc5-b4b5-8760debb7e9a req-82009921-2a65-47cb-af02-1e90cb02fd9a service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:27.969229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-72bb87e3-25b0-4fc5-b4b5-8760debb7e9a req-82009921-2a65-47cb-af02-1e90cb02fd9a service nova] Creating event network-changed:3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e for instance 06d7d294-5cc6-4500-9845-3ce118d36e6f on hv-cinder-82481 Jan 15 16:24:27.984860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-72bb87e3-25b0-4fc5-b4b5-8760debb7e9a req-82009921-2a65-47cb-af02-1e90cb02fd9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032024 Jan 15 16:24:27.984860 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 969/1983] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:24:28.308409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5d39c59b-adb6-4572-a2cb-10054b70f4e0 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "POST /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766517 Jan 15 16:24:28.309028 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1015/1984] 10.222.0.36 () {60 vars in 1322 bytes} [Sat Jan 15 16:24:27 2022] POST /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:28.682686 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:28.683382 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:28.690161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:28.693267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:28.693267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:28.693267 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:28.824823 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:28.832091 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-48f4557f-c337-418c-af3d-cd12fa27d01c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.153580 Jan 15 16:24:28.832688 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 970/1985] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:28 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:29.850373 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:29.851079 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:29.858235 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:29.858685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:29.859467 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:29.859912 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:29.993817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:30.001803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-1aebd2d2-e9f9-4b2b-961c-88e3dbf0156b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.155490 Jan 15 16:24:30.002357 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1016/1986] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:29 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:31.018175 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:31.018840 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:31.025261 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:31.025712 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:31.026496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:31.026930 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:31.315530 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:31.322700 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-16a53dec-fc8f-4ca3-b350-0612da8d725b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.308236 Jan 15 16:24:31.323254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 971/1987] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:31 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:32.339966 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:32.341050 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:32.347353 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:32.347806 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:32.348625 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:32.349071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:32.485325 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:32.486082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-804c5c7d-11db-4273-9162-f8716b8f313a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.149932 Jan 15 16:24:32.486660 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1017/1988] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:32 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:33.503266 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:33.503885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:33.509940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:33.510384 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:33.511152 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:33.511583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:33.644841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:33.652114 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d3acc9e3-dafd-429f-bb7b-dc979a167c3c tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.152534 Jan 15 16:24:33.652855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 972/1989] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:33 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:34.668856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:34.669478 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:34.676690 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:34.677145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:34.677925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:34.678366 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:34.811576 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:34.818726 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b5459003-c199-485e-b555-14a473d53387 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.153746 Jan 15 16:24:34.819280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1018/1990] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:34 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:35.846106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:35.846106 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:35.849318 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:35.849883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:35.850750 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:35.851197 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:35.853274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:35.853792 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:35.860617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:35.861071 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:35.861856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:35.862549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:35.943005 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lazy-loading 'services' on Instance uuid 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:24:36.004053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:36.011535 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f2299f46-80aa-4642-94b5-a1e268196c49 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.178875 Jan 15 16:24:36.012096 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 973/1991] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:35 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:36.091224 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ba5b55c0-d719-4aa6-844b-7db43529ebb8 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments/9812b444-ebcb-40a6-8673-334d6666dd0e" status: 202 len: 0 microversion: 2.1 time: 0.241488 Jan 15 16:24:36.092355 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1019/1992] 10.222.0.36 () {58 vars in 1415 bytes} [Sat Jan 15 16:24:35 2022] DELETE /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments/9812b444-ebcb-40a6-8673-334d6666dd0e => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 16:24:36.100379 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b90974bb-a129-417b-94a2-b911726d4d0b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:36.101306 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b90974bb-a129-417b-94a2-b911726d4d0b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:36.107805 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b90974bb-a129-417b-94a2-b911726d4d0b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:36.108305 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b90974bb-a129-417b-94a2-b911726d4d0b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:36.109103 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b90974bb-a129-417b-94a2-b911726d4d0b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:36.109545 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b90974bb-a129-417b-94a2-b911726d4d0b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:36.138841 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b90974bb-a129-417b-94a2-b911726d4d0b tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Jan 15 16:24:36.139378 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 974/1993] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:24:36 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:37.029299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:37.030055 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:37.036243 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:37.036730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:37.037552 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:37.037999 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:37.150444 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c8d17c6a-bad5-4ecd-bdf7-8dbf7d5412de tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:37.151364 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c8d17c6a-bad5-4ecd-bdf7-8dbf7d5412de tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:37.159326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8d17c6a-bad5-4ecd-bdf7-8dbf7d5412de tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:37.159782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8d17c6a-bad5-4ecd-bdf7-8dbf7d5412de tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:37.161208 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8d17c6a-bad5-4ecd-bdf7-8dbf7d5412de tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:37.161998 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c8d17c6a-bad5-4ecd-bdf7-8dbf7d5412de tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:37.175771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:37.183190 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d734e448-5a58-4ca1-a32f-8ebfe69d6115 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.158668 Jan 15 16:24:37.183778 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1020/1994] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:37 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:37.193772 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c8d17c6a-bad5-4ecd-bdf7-8dbf7d5412de tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047247 Jan 15 16:24:37.194588 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 975/1995] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:24:37 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:24:38.202328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:38.202959 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:38.205506 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-1ecc2c46-2c66-47ae-9447-d7df66b79fff tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:38.206418 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-1ecc2c46-2c66-47ae-9447-d7df66b79fff tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:38.209374 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:38.209817 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:38.210597 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:38.211026 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:38.212646 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ecc2c46-2c66-47ae-9447-d7df66b79fff tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:38.213137 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ecc2c46-2c66-47ae-9447-d7df66b79fff tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:38.213969 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ecc2c46-2c66-47ae-9447-d7df66b79fff tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:38.214413 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-1ecc2c46-2c66-47ae-9447-d7df66b79fff tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:38.243753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-1ecc2c46-2c66-47ae-9447-d7df66b79fff tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042080 Jan 15 16:24:38.244333 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 976/1996] 10.222.0.36 () {58 vars in 1301 bytes} [Sat Jan 15 16:24:38 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 16:24:38.343123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:38.350254 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-0e9ecdbd-48c3-4ec5-b032-23f997328284 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.152784 Jan 15 16:24:38.350803 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1021/1997] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:38 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:39.367025 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:39.367643 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:39.374035 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:39.374485 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:39.375273 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:39.375717 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:39.470439 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-f678034a-6ffa-4a5c-83ec-c8de02a1519f req-58e3606f-5997-4826-a65c-3e09da9034e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d7d294-5cc6-4500-9845-3ce118d36e6f", "name": "network-vif-plugged", "status": "completed", "tag": "3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:39.472299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:39.472299 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:24:39.479770 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-f678034a-6ffa-4a5c-83ec-c8de02a1519f req-58e3606f-5997-4826-a65c-3e09da9034e6 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:39.480316 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-f678034a-6ffa-4a5c-83ec-c8de02a1519f req-58e3606f-5997-4826-a65c-3e09da9034e6 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:39.491463 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-f678034a-6ffa-4a5c-83ec-c8de02a1519f req-58e3606f-5997-4826-a65c-3e09da9034e6 service nova] Creating event network-vif-plugged:3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e for instance 06d7d294-5cc6-4500-9845-3ce118d36e6f on hv-cinder-82481 Jan 15 16:24:39.496577 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-f678034a-6ffa-4a5c-83ec-c8de02a1519f req-58e3606f-5997-4826-a65c-3e09da9034e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031062 Jan 15 16:24:39.497314 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1022/1998] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 16:24:39.512282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:39.520603 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-430308a1-19fc-4295-8aae-6cfd8a2f4bfa tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.157309 Jan 15 16:24:39.521177 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 977/1999] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:39 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:39.600518 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:39.601210 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:39.608255 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:39.608800 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:39.609669 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:39.610183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:39.634620 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:24:39.950001 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-c5c7efa1-d391-49cd-9b1b-5bbf8e3d8c28 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 204 len: 0 microversion: 2.1 time: 0.353462 Jan 15 16:24:39.950668 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1023/2000] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:24:39 2022] DELETE /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:24:39.958528 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:39.959146 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:39.964963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:39.965415 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:39.966776 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:39.967323 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:40.098115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:40.105383 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4100def2-0c99-4054-8912-61724b3a365f tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1512 microversion: 2.1 time: 0.150522 Jan 15 16:24:40.105931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 978/2001] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:39 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:40.543657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:40.544454 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:40.550925 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:40.551420 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:40.552247 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:40.552739 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:40.687178 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:40.694381 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-265e6d00-8f2b-4262-bf94-a7213fbdf84d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1260 microversion: 2.1 time: 0.154775 Jan 15 16:24:40.694946 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1024/2002] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:40 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:41.123726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:41.124372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:41.130648 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:41.131105 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:41.131888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:41.132368 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:41.259963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:41.268063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3d72438a-50b9-4ec3-8f39-fd6ae5313791 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1512 microversion: 2.1 time: 0.148602 Jan 15 16:24:41.268929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 979/2003] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:41 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:41.710698 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:41.711339 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:41.718212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:41.718658 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:41.719435 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:41.719875 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:41.851943 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:41.859519 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-113a4804-4493-464f-b8d7-352c867d6ece tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1444 microversion: 2.1 time: 0.152496 Jan 15 16:24:41.860086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1025/2004] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:41 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:41.875496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:41.876108 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:41.881833 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:41.882279 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:41.883052 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:41.883489 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:42.012512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:42.020156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ce72cc7b-cd56-4327-955f-6f09ad851f3b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1444 microversion: 2.1 time: 0.148521 Jan 15 16:24:42.020713 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 980/2005] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:41 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:42.285063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:42.285684 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:42.291466 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:42.291922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:42.292743 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:42.293185 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:42.503165 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:42.510849 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-f3c0269e-0d53-4f78-8dfc-7f68dde78f4c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1512 microversion: 2.1 time: 0.229383 Jan 15 16:24:42.511632 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1026/2006] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:42 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:42.959703 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-d6999ace-9679-44fe-ace3-669c2c31a95b req-53df66bd-09a3-48e3-ba66-0d954b749edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a", "name": "network-vif-deleted", "tag": "af235e27-aeec-4770-a434-69daab17d4fc"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:42.962037 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:42.962037 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:24:42.970704 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-d6999ace-9679-44fe-ace3-669c2c31a95b req-53df66bd-09a3-48e3-ba66-0d954b749edb service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:42.971159 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-d6999ace-9679-44fe-ace3-669c2c31a95b req-53df66bd-09a3-48e3-ba66-0d954b749edb service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:42.983791 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-d6999ace-9679-44fe-ace3-669c2c31a95b req-53df66bd-09a3-48e3-ba66-0d954b749edb service nova] Creating event network-vif-deleted:af235e27-aeec-4770-a434-69daab17d4fc for instance 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a on hv-cinder-82481 Jan 15 16:24:42.989150 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-d6999ace-9679-44fe-ace3-669c2c31a95b req-53df66bd-09a3-48e3-ba66-0d954b749edb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Jan 15 16:24:42.989932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 981/2007] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:43.528086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:43.528890 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:43.556445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:43.556894 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:43.557685 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:43.558127 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:43.588557 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:43.589017 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:43.589462 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lazy-loading 'fault' on Instance uuid 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:24:43.657930 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:43.664323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-466e75de-2bfe-4bb5-a1ec-1845c7674d48 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 200 len: 1307 microversion: 2.1 time: 0.139777 Jan 15 16:24:43.664922 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1027/2008] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:43 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:44.271984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-f90398c8-1a96-4b2a-9890-e121a21659a1 req-54b49783-9b03-46cc-9df6-3f1ff8d3ebd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d7d294-5cc6-4500-9845-3ce118d36e6f", "tag": "3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:44.273602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:44.273602 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:24:44.280861 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-f90398c8-1a96-4b2a-9890-e121a21659a1 req-54b49783-9b03-46cc-9df6-3f1ff8d3ebd3 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:44.281308 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-f90398c8-1a96-4b2a-9890-e121a21659a1 req-54b49783-9b03-46cc-9df6-3f1ff8d3ebd3 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:44.291597 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-f90398c8-1a96-4b2a-9890-e121a21659a1 req-54b49783-9b03-46cc-9df6-3f1ff8d3ebd3 service nova] Creating event network-changed:3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e for instance 06d7d294-5cc6-4500-9845-3ce118d36e6f on hv-cinder-82481 Jan 15 16:24:44.297290 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-f90398c8-1a96-4b2a-9890-e121a21659a1 req-54b49783-9b03-46cc-9df6-3f1ff8d3ebd3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087285 Jan 15 16:24:44.298115 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 982/2009] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:44.682445 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:44.683189 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:44.690274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:44.690722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:44.691514 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:44.691953 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:44.706839 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] HTTP exception thrown: Instance 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a could not be found. Jan 15 16:24:44.707730 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Returning 404 to user: Instance 2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:24:44.708587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-4a24ea80-b614-4e44-9f03-12ef259e076c tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a" status: 404 len: 111 microversion: 2.1 time: 0.030613 Jan 15 16:24:44.711936 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1028/2010] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:44 2022] GET /compute/v2.1/servers/2ad0bece-72b0-4c0c-9f63-d11c2b21fa6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:24:46.002985 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:46.003550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:46.009533 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:46.009984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:46.010760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:46.011193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:46.036402 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:24:46.307993 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-012856c2-cf3f-42f7-8325-5c637ea1eb62 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 204 len: 0 microversion: 2.1 time: 0.309268 Jan 15 16:24:46.308617 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 983/2011] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:24:45 2022] DELETE /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 16:24:46.320035 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:46.320683 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:46.327227 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:46.327682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:46.328487 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:46.328956 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:46.456995 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:46.464131 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d25d5027-0fa1-4fbc-8cef-25f1a29ce1e4 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1513 microversion: 2.1 time: 0.147818 Jan 15 16:24:46.464697 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1029/2012] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:46 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:47.481398 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:47.482245 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:47.488762 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:47.489211 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:47.490034 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:47.490439 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:47.619065 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:47.626936 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b585e94a-9a2e-49df-9b3b-34a383825940 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1513 microversion: 2.1 time: 0.149634 Jan 15 16:24:47.627491 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 984/2013] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:47 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:48.643223 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:48.643923 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:48.650645 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:48.651121 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:48.662315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:48.662315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:48.719864 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:48.730096 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-72306828-f7da-413e-8c4a-9b10cbc8c1ce tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 200 len: 1471 microversion: 2.1 time: 0.090528 Jan 15 16:24:48.731083 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1030/2014] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:48 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:48.740193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-80fa9e17-6c1b-46a1-9578-aff512a574a6 req-8a09a6ea-dd19-48f1-b932-3fc179ed86ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c783e66e-097b-4cbd-884c-2ecf3a8b2de0", "name": "network-vif-deleted", "tag": "aab8845d-2098-45c8-b97b-a8cfb3e7bacb"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:48.742326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:48.742326 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:24:48.749708 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-80fa9e17-6c1b-46a1-9578-aff512a574a6 req-8a09a6ea-dd19-48f1-b932-3fc179ed86ef service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:48.750161 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-80fa9e17-6c1b-46a1-9578-aff512a574a6 req-8a09a6ea-dd19-48f1-b932-3fc179ed86ef service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:48.760924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-80fa9e17-6c1b-46a1-9578-aff512a574a6 req-8a09a6ea-dd19-48f1-b932-3fc179ed86ef service nova] Creating event network-vif-deleted:aab8845d-2098-45c8-b97b-a8cfb3e7bacb for instance c783e66e-097b-4cbd-884c-2ecf3a8b2de0 on hv-cinder-82481 Jan 15 16:24:48.766376 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-80fa9e17-6c1b-46a1-9578-aff512a574a6 req-8a09a6ea-dd19-48f1-b932-3fc179ed86ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030090 Jan 15 16:24:48.766974 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 985/2015] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:49.746873 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:49.747624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: c783e66e-097b-4cbd-884c-2ecf3a8b2de0] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:49.754264 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:49.754717 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:49.755498 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:49.755933 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:49.769086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] HTTP exception thrown: Instance c783e66e-097b-4cbd-884c-2ecf3a8b2de0 could not be found. Jan 15 16:24:49.769855 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Returning 404 to user: Instance c783e66e-097b-4cbd-884c-2ecf3a8b2de0 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:24:49.770687 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-667895a5-c8e1-426d-99a1-50ef14f4ccd7 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0" status: 404 len: 111 microversion: 2.1 time: 0.027662 Jan 15 16:24:49.771215 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1031/2016] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:49 2022] GET /compute/v2.1/servers/c783e66e-097b-4cbd-884c-2ecf3a8b2de0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:24:49.780723 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:49.781331 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:49.787351 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:49.787802 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:49.788610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:49.789060 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:49.815731 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:24:50.052458 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-22cc2f59-4e67-40ed-b0b8-cec8caf12355 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 204 len: 0 microversion: 2.1 time: 0.276651 Jan 15 16:24:50.053201 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 986/2017] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:24:49 2022] DELETE /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:24:50.061013 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:50.061631 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:50.067489 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:50.067941 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:50.068760 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:50.069195 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:50.195407 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:50.203586 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-efedaa7c-b4a0-4a3a-b572-5ab53c27f468 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1511 microversion: 2.1 time: 0.146389 Jan 15 16:24:50.204157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1032/2018] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:50 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:51.220745 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:51.221456 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:51.227739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:51.228229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:51.229024 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:51.229472 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:51.358844 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:51.366550 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9e15049a-c146-4122-ace9-4e2421cbf257 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1511 microversion: 2.1 time: 0.149864 Jan 15 16:24:51.367116 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 987/2019] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:51 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:52.328304 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-768b6bd5-c503-4776-9b43-edca3142bab3 req-3a665fbd-7b95-4254-8b8c-cf22ce88c65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5517638-6ee9-476d-bfb7-8fd432df1b7e", "name": "network-vif-deleted", "tag": "8ba4350b-66c4-4f7b-9512-7fc6767175ee"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:52.330819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:52.330819 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:24:52.338231 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-768b6bd5-c503-4776-9b43-edca3142bab3 req-3a665fbd-7b95-4254-8b8c-cf22ce88c65c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:52.343964 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-768b6bd5-c503-4776-9b43-edca3142bab3 req-3a665fbd-7b95-4254-8b8c-cf22ce88c65c service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:52.350379 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.compute.server_external_events [req-768b6bd5-c503-4776-9b43-edca3142bab3 req-3a665fbd-7b95-4254-8b8c-cf22ce88c65c service nova] Creating event network-vif-deleted:8ba4350b-66c4-4f7b-9512-7fc6767175ee for instance d5517638-6ee9-476d-bfb7-8fd432df1b7e on hv-cinder-82481 Jan 15 16:24:52.355324 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-768b6bd5-c503-4776-9b43-edca3142bab3 req-3a665fbd-7b95-4254-8b8c-cf22ce88c65c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031301 Jan 15 16:24:52.355908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1033/2020] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:52.383750 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:52.384401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:52.391622 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:52.392069 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:52.392925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:52.393372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:52.458618 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:52.466778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0a705b60-dac0-4aae-9ae6-c21851faf0af tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 200 len: 1469 microversion: 2.1 time: 0.086071 Jan 15 16:24:52.467583 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 988/2021] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:52 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 1469 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:53.485560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:53.486257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: d5517638-6ee9-476d-bfb7-8fd432df1b7e] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:53.492525 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:53.492970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:53.493746 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:53.494177 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:53.507280 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] HTTP exception thrown: Instance d5517638-6ee9-476d-bfb7-8fd432df1b7e could not be found. Jan 15 16:24:53.507850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Returning 404 to user: Instance d5517638-6ee9-476d-bfb7-8fd432df1b7e could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:24:53.508682 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-711cf310-9d70-402c-8697-0b1e88169ec9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e" status: 404 len: 111 microversion: 2.1 time: 0.028696 Jan 15 16:24:53.509199 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1034/2022] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:53 2022] GET /compute/v2.1/servers/d5517638-6ee9-476d-bfb7-8fd432df1b7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:24:54.780269 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:54.780782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:54.786988 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:54.787443 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:54.788259 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:54.788705 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:54.813475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Going to try to terminate instance {{(pid=123221) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:24:55.103522 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-18723492-3446-4505-8b79-c4f9afdb2287 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 204 len: 0 microversion: 2.1 time: 0.326691 Jan 15 16:24:55.104111 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 989/2023] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:24:54 2022] DELETE /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:24:55.112996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:55.120176 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:55.120713 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:55.121170 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:55.121951 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:55.122409 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:55.256475 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:55.259624 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2db3f762-de5d-46f0-b43a-58a5ce4ede77 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1514 microversion: 2.1 time: 0.150593 Jan 15 16:24:55.260203 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1035/2024] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:55 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:56.277375 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:56.278123 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:56.284754 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:56.285207 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:56.285984 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:56.286417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:56.415214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:56.422584 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-5e7209f4-96e1-49a5-b611-4689d329d2a1 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1514 microversion: 2.1 time: 0.149208 Jan 15 16:24:56.423147 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 990/2025] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:56 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:57.438854 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:57.439561 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:57.445908 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:57.446360 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:57.447130 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:57.447565 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:57.587559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13df32b632904102baf80323020194b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eacc08c2974c51a483628551748c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:24:57.595538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a06e86aa-a0b3-44be-be2e-2ce4526905e6 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 200 len: 1514 microversion: 2.1 time: 0.160584 Jan 15 16:24:57.596338 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1036/2026] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:57 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:24:57.627412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-98d9e141-ec86-4d27-96fd-77a4288a7e63 req-6ac20687-dc27-47d8-884b-971f53439a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc5edbb-89ba-4f33-93e0-ac1bc3b74019", "name": "network-vif-deleted", "tag": "c7457ca3-7592-4fe3-8b18-0c136409a485"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:24:57.629053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:24:57.629053 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:24:57.636329 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-98d9e141-ec86-4d27-96fd-77a4288a7e63 req-6ac20687-dc27-47d8-884b-971f53439a79 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:57.637782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-98d9e141-ec86-4d27-96fd-77a4288a7e63 req-6ac20687-dc27-47d8-884b-971f53439a79 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:57.648089 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-98d9e141-ec86-4d27-96fd-77a4288a7e63 req-6ac20687-dc27-47d8-884b-971f53439a79 service nova] Creating event network-vif-deleted:c7457ca3-7592-4fe3-8b18-0c136409a485 for instance 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 on hv-cinder-82481 Jan 15 16:24:57.653357 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-98d9e141-ec86-4d27-96fd-77a4288a7e63 req-6ac20687-dc27-47d8-884b-971f53439a79 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029726 Jan 15 16:24:57.654765 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 991/2027] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:24:58.612616 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:24:58.613157 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] [instance: 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:24:58.619412 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:58.619861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:58.620671 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:24:58.621112 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:24:58.635309 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] HTTP exception thrown: Instance 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 could not be found. Jan 15 16:24:58.637856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] Returning 404 to user: Instance 9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:24:58.637856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-a213ad58-cca6-44c3-aae1-aa008735aae9 tempest-AttachVolumeNegativeTest-555892798 tempest-AttachVolumeNegativeTest-555892798-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019" status: 404 len: 111 microversion: 2.1 time: 0.028118 Jan 15 16:24:58.637856 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1037/2028] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:24:58 2022] GET /compute/v2.1/servers/9bc5edbb-89ba-4f33-93e0-ac1bc3b74019 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:25:01.350085 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-059c9dd2-6e58-4154-84e6-fa66d46aeb95 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Action: 'create', calling method: .version_select at 0x7f216c969670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1236145453", "metadata": {"Type": "work"}}} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:25:01.969198 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-059c9dd2-6e58-4154-84e6-fa66d46aeb95 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.727374 Jan 15 16:25:01.969885 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 992/2029] 10.222.0.36 () {60 vars in 1155 bytes} [Sat Jan 15 16:25:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 729 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 15 16:25:01.980559 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-d6e04127-475e-4a62-97dd-6ac4163ada0b tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Calling method '.version_select at 0x7f216c9b7c10>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:25:02.032086 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-d6e04127-475e-4a62-97dd-6ac4163ada0b tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8" status: 200 len: 353 microversion: 2.1 time: 0.055037 Jan 15 16:25:02.032677 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1038/2030] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 16:25:01 2022] GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:25:03.044981 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d5f27dca-6560-4572-8f0d-70baa99b8d54 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Calling method '.version_select at 0x7f2168126280>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:25:03.092055 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d5f27dca-6560-4572-8f0d-70baa99b8d54 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8" status: 200 len: 354 microversion: 2.1 time: 0.051326 Jan 15 16:25:03.092764 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 993/2031] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 16:25:03 2022] GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:25:03.103655 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-876c6e31-1efb-406f-803b-21937c8940ef tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Calling method '.version_select at 0x7f216821f940>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:25:03.147884 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-876c6e31-1efb-406f-803b-21937c8940ef tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8" status: 200 len: 354 microversion: 2.1 time: 0.048199 Jan 15 16:25:03.148461 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1039/2032] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 16:25:03 2022] GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:25:03.163870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-0b0abfae-b1d7-43f7-aa57-2b981190cd00 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Calling method '.version_select at 0x7f2163752c10>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:25:03.337018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-0b0abfae-b1d7-43f7-aa57-2b981190cd00 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8" status: 202 len: 0 microversion: 2.1 time: 0.176695 Jan 15 16:25:03.337664 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 994/2033] 10.222.0.36 () {58 vars in 1247 bytes} [Sat Jan 15 16:25:03 2022] DELETE /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:25:03.347470 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-37dc93c5-4aa5-40a2-a314-9a1ca9e75cb2 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Calling method '.version_select at 0x7f2163634940>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:25:03.393095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-37dc93c5-4aa5-40a2-a314-9a1ca9e75cb2 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8" status: 200 len: 353 microversion: 2.1 time: 0.050445 Jan 15 16:25:03.393657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1040/2034] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 16:25:03 2022] GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:25:04.405827 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-482c2083-1d6e-4d44-afc6-449d79364729 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Calling method '.version_select at 0x7f216811e430>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:25:04.431193 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.wsgi [None req-482c2083-1d6e-4d44-afc6-449d79364729 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] HTTP exception thrown: Volume d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 could not be found. Jan 15 16:25:04.431782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-482c2083-1d6e-4d44-afc6-449d79364729 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] Returning 404 to user: Volume d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 could not be found. {{(pid=123221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:25:04.432644 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-482c2083-1d6e-4d44-afc6-449d79364729 tempest-VolumesGetTestJSON-1290846749 tempest-VolumesGetTestJSON-1290846749-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8" status: 404 len: 109 microversion: 2.1 time: 0.031043 Jan 15 16:25:04.433166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 995/2035] 10.222.0.36 () {58 vars in 1244 bytes} [Sat Jan 15 16:25:04 2022] GET /compute/v2.1/os-volumes/d78bf5ad-fc3e-4f71-b6fd-eac6d8a942b8 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:26:59.200674 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:26:59.201230 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:26:59.208386 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:26:59.210729 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:26:59.210847 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:26:59.211248 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:26:59.234340 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.objects.instance [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lazy-loading 'flavor' on Instance uuid 06d7d294-5cc6-4500-9845-3ce118d36e6f {{(pid=123220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:26:59.512323 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-660f285f-1826-40af-918e-3ea6ad222315 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "POST /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f/action" status: 202 len: 0 microversion: 2.1 time: 0.316944 Jan 15 16:26:59.512905 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1041/2036] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:26:59 2022] POST /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:26:59.522929 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:26:59.523673 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:26:59.529756 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:26:59.535726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:26:59.535726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:26:59.535726 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:26:59.845287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:26:59.852758 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-917dbd50-60ea-4399-ad97-ea07812de23b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.335462 Jan 15 16:26:59.853317 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 996/2037] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:26:59 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:00.872306 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:00.873016 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:00.879093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:00.879545 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:00.881063 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:00.881529 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:01.009538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:01.016977 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-7dbefb32-6e02-42e7-a70c-19f452c51322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.149195 Jan 15 16:27:01.017538 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1042/2038] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:00 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:02.034176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:02.034751 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:02.041920 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:02.042369 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:02.043149 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:02.043586 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:02.175299 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:02.182997 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-4bbd11f2-21b3-49ee-9295-d9c11b3cc681 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.152625 Jan 15 16:27:02.183548 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 997/2039] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:02 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:03.199328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:03.199980 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:03.205844 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:03.206294 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:03.207069 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:03.207509 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:03.335867 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:03.343202 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-02abfceb-1530-4444-ad81-5bf1a5fde7d7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.147635 Jan 15 16:27:03.349595 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1043/2040] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:03 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:04.361229 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:04.361888 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:04.369007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:04.369457 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:04.370599 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:04.371294 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:04.498143 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:04.505552 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9c6d32a7-ff4f-4b9a-acb4-26c975ac7ed5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.147898 Jan 15 16:27:04.506334 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 998/2041] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:04 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:05.522688 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:05.523327 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:05.529520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:05.529970 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:05.530747 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:05.531183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:05.664676 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:05.671961 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-31869441-3a46-4363-9ff1-b8a430882ab9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.153523 Jan 15 16:27:05.672550 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1044/2042] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:05 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:06.690932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:06.691573 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:06.698268 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:06.698719 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:06.699496 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:06.699932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:06.826264 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:06.833523 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6d33fc4e-9e3f-4f83-b3a5-6cc4a422eeb8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.146321 Jan 15 16:27:06.834075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 999/2043] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:06 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:07.850850 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:07.851482 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:07.857972 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:07.858417 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:07.859216 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:07.859649 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:08.047853 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:08.056276 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-52d4521f-f275-4bb0-83a2-7f99b2ceb344 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.209059 Jan 15 16:27:08.056828 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1045/2044] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:07 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:09.073464 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:09.074074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:09.080327 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:09.080778 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:09.081553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:09.081991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:09.213112 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:09.220372 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-3835ff16-f4df-4f92-96a7-5e0496951eef tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.150755 Jan 15 16:27:09.220932 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1000/2045] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:09 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:10.238057 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:10.238666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:10.245093 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:10.245539 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:10.246311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:10.246742 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:10.387336 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:10.402507 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ac96ca1b-3154-4996-a79f-dbc826a70e0d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.167668 Jan 15 16:27:10.403583 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1046/2046] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:10 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:11.419512 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:11.420167 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:11.426445 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:11.426894 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:11.427666 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:11.428166 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:11.556176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:11.563421 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-fc03a279-2f12-4fcb-bc78-df23e43c7eac tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.147580 Jan 15 16:27:11.563987 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1001/2047] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:11 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:12.579492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:12.580107 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:12.586628 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:12.587104 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:12.587938 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:12.588410 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:12.720520 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:12.728422 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2739a9e6-d8b8-47f7-95fe-73d6b7697d4b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1568 microversion: 2.1 time: 0.152703 Jan 15 16:27:12.728987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1047/2048] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:12 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:13.746059 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:13.746706 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:13.752950 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:13.753399 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:13.754176 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:13.754611 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:13.886661 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:13.893855 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-d20470a0-ab7b-4e0d-91fd-5152face80c9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1509 microversion: 2.1 time: 0.151520 Jan 15 16:27:13.894412 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1002/2049] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:13 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:27:13.914571 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:27:13.915136 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:13.921335 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:13.921783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:13.922550 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:13.922981 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:14.095492 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [b002c091-6545-4502-89b2-70da13e60023] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:27:15.103477 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [b002c091-6545-4502-89b2-70da13e60023] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44382. Jan 15 16:27:15.107401 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5c60ce26-2c0b-4838-98d7-58af525e44e2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "POST /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f/action" status: 202 len: 0 microversion: 2.1 time: 1.196757 Jan 15 16:27:15.108008 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1048/2050] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Jan 15 16:27:13 2022] POST /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f/action => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:27:15.115800 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:15.116733 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:15.123156 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:15.123744 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:15.124601 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:15.125042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:15.258763 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:15.266254 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-9351682e-18fc-44d5-a93b-e183c6ede51a tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1517 microversion: 2.1 time: 0.154180 Jan 15 16:27:15.266828 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1003/2051] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:15 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:16.164047 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [req-037714fc-9d14-40b6-9859-32d5b801d9f0 req-268a05bf-d691-4b36-bea1-e9188c109bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d7d294-5cc6-4500-9845-3ce118d36e6f", "name": "network-vif-unplugged", "status": "completed", "tag": "3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e"}]} {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:27:16.165782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:27:16.165782 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: warnings.warn(msg) Jan 15 16:27:16.173303 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-037714fc-9d14-40b6-9859-32d5b801d9f0 req-268a05bf-d691-4b36-bea1-e9188c109bed service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:16.173749 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [req-037714fc-9d14-40b6-9859-32d5b801d9f0 req-268a05bf-d691-4b36-bea1-e9188c109bed service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:16.184128 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.compute.server_external_events [req-037714fc-9d14-40b6-9859-32d5b801d9f0 req-268a05bf-d691-4b36-bea1-e9188c109bed service nova] Unable to find a host for instance 06d7d294-5cc6-4500-9845-3ce118d36e6f. Dropping event network-vif-unplugged {{(pid=123220) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 15 16:27:16.185012 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [req-037714fc-9d14-40b6-9859-32d5b801d9f0 req-268a05bf-d691-4b36-bea1-e9188c109bed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025281 Jan 15 16:27:16.185758 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1049/2052] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 16:27:16.282945 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:16.283727 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:16.291460 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:16.291931 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:16.292739 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:16.293179 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:16.434278 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:16.441818 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-db2c2641-ea7c-4942-abae-d76103892fa5 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1517 microversion: 2.1 time: 0.162608 Jan 15 16:27:16.442465 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1004/2053] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:16 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:17.459183 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:17.460160 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:17.466722 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:17.467164 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:17.467942 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:17.468397 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:17.610868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:17.619761 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ac966032-d37f-4d6c-9b18-3438c630e074 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1517 microversion: 2.1 time: 0.164787 Jan 15 16:27:17.621150 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1050/2054] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:17 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:18.636427 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:18.637042 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:18.643187 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:18.643642 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:18.644461 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:18.644904 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:18.776063 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:18.783883 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-7a4feb00-4481-41ca-ab27-c1688758769e tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1517 microversion: 2.1 time: 0.150704 Jan 15 16:27:18.784060 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1005/2055] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:18 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:19.800287 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:19.800898 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:19.807587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:19.808031 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:19.808831 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:19.809260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:19.938588 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:19.946646 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-8e9601aa-3c6d-4d4f-b78f-3ed3935bdcf0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1517 microversion: 2.1 time: 0.150198 Jan 15 16:27:19.947213 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1051/2056] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:19 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:20.963347 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:20.963947 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:20.970429 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:20.972854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:20.972854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:20.972854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:21.109230 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:21.116925 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-48989db7-8555-4e7a-9861-30b4a099f8cb tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1519 microversion: 2.1 time: 0.157390 Jan 15 16:27:21.117504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1006/2057] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:20 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:22.133456 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:22.134208 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:22.140394 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:22.140846 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:22.141617 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:22.142692 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:22.274023 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:22.281226 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-071eae6c-671f-49f1-8f9e-815ab56473ed tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.151749 Jan 15 16:27:22.281783 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1052/2058] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:22 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:23.297498 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:23.298032 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:23.305206 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:23.305657 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:23.306438 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:23.306870 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:23.436282 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:23.443518 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-43f8c6bc-45f2-4c28-9c55-d040e2caf7b4 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.149809 Jan 15 16:27:23.444718 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1007/2059] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:23 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:24.460887 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:24.461560 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:24.467756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:24.468223 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:24.468996 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:24.469430 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:24.604088 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:24.611621 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-5191a615-c095-4bf1-a580-3ecb8f00b9c6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.154515 Jan 15 16:27:24.612181 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1053/2060] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:24 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:25.628645 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:25.629287 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:25.638961 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:25.639406 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:25.640204 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:25.640640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:25.770653 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:25.778043 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-f25414fa-08fa-4dfa-8ae7-b47e797bfdfe tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.153087 Jan 15 16:27:25.778604 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1008/2061] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:25 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:26.794696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:26.795315 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:26.801589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:26.802038 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:26.802807 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:26.803483 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:26.934123 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:26.942918 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-948ff107-2692-4406-91bb-c492d8f8fb12 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.151893 Jan 15 16:27:26.944274 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1054/2062] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:26 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:27.961991 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:27.962610 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:27.968882 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:27.969338 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:27.970120 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:27.970561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:28.100504 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:28.108031 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-2f0651b3-7af1-489f-8355-d8838ccfd7bc tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.149738 Jan 15 16:27:28.108624 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1009/2063] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:27 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:29.125152 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:29.125771 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:29.132633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:29.133084 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:29.133861 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:29.134301 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:29.261460 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:29.268719 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ee6d59c5-b5ac-40e3-9da0-31e9c9c2fd17 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.147294 Jan 15 16:27:29.269277 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1055/2064] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:29 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:30.286119 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:30.286689 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:30.293566 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:30.294019 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:30.294799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:30.295235 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:30.426284 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:30.433640 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-ff4490f8-a0b2-4f66-8b07-91e768d29cd0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.151296 Jan 15 16:27:30.434205 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1010/2065] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:30 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:31.450554 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:31.451167 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:31.457375 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:31.457838 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:31.458587 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:31.459020 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:31.586572 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:31.593852 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-43a24dd1-cb2e-4179-9f15-fa454c7bd68d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.146946 Jan 15 16:27:31.594427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1056/2066] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:31 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:32.610799 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:32.611420 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:32.617926 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:32.618386 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:32.619178 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:32.619616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:32.755158 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:32.763432 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-98348746-1aac-44aa-86bb-e9795c9de0f6 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.156323 Jan 15 16:27:32.767683 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1011/2067] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:32 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:33.780378 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:33.780985 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:33.786859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:33.787906 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:33.788709 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:33.789145 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:33.918526 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:33.925885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-818a02bc-c73a-4bdf-a532-a8f77c519322 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.149348 Jan 15 16:27:33.926440 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1057/2068] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:33 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:34.383319 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-05a44f93-b54e-4110-bef5-c81fd0ad9e2f req-5db2d0b2-caf0-4a30-b0a8-83581da026af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d7d294-5cc6-4500-9845-3ce118d36e6f", "name": "network-vif-plugged", "status": "completed", "tag": "3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:27:34.384940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:27:34.384940 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:27:34.391532 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-05a44f93-b54e-4110-bef5-c81fd0ad9e2f req-5db2d0b2-caf0-4a30-b0a8-83581da026af service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:34.391975 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-05a44f93-b54e-4110-bef5-c81fd0ad9e2f req-5db2d0b2-caf0-4a30-b0a8-83581da026af service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:34.403650 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-05a44f93-b54e-4110-bef5-c81fd0ad9e2f req-5db2d0b2-caf0-4a30-b0a8-83581da026af service nova] Creating event network-vif-plugged:3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e for instance 06d7d294-5cc6-4500-9845-3ce118d36e6f on hv-cinder-82481 Jan 15 16:27:34.407194 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [req-05a44f93-b54e-4110-bef5-c81fd0ad9e2f req-5db2d0b2-caf0-4a30-b0a8-83581da026af service nova] [23f1be4a-413a-457f-b321-ff03f7f83f0e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:27:34.942082 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:34.942633 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:34.948975 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:34.949433 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:34.950212 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:34.950652 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:35.083448 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:35.090868 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-2561d96d-365a-4642-9aab-956de5f92e8d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.152569 Jan 15 16:27:35.091484 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1058/2069] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:34 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 16:27:35.414354 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [req-05a44f93-b54e-4110-bef5-c81fd0ad9e2f req-5db2d0b2-caf0-4a30-b0a8-83581da026af service nova] [23f1be4a-413a-457f-b321-ff03f7f83f0e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44450. Jan 15 16:27:35.418592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-05a44f93-b54e-4110-bef5-c81fd0ad9e2f req-5db2d0b2-caf0-4a30-b0a8-83581da026af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.097638 Jan 15 16:27:35.418592 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1012/2070] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:27:36.108695 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:36.109311 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:36.117306 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:36.117756 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:36.118530 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:36.118968 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:36.247474 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:36.254696 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-b78c2084-5151-4750-b493-f5cf5897253b tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1575 microversion: 2.1 time: 0.149948 Jan 15 16:27:36.255258 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1059/2071] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:36 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:27:37.272760 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:27:37.273508 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:27:37.279553 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:37.280007 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:37.280836 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:27:37.281293 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:27:37.413743 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:27:37.421113 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-6407cd5c-acea-4663-a53f-7c434079e11d tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1562 microversion: 2.1 time: 0.153162 Jan 15 16:27:37.424342 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1013/2072] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:27:37 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:28:17.714904 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:28:17.715698 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:28:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:28:24.331854 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:28:24.332450 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:28:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:28:33.873396 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:28:33.874022 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:29:07.255320 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [-] [14db0917-d513-4ff7-a257-d7f8104704fb] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 16:29:07.259675 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:29:07.260289 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:29:07.261401 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 16:29:07.266341 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:07.266824 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:07.267607 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:07.268427 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:07.293513 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Going to try to terminate instance {{(pid=123220) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 16:29:07.318639 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-fd17e8f0-72d0-4e4a-bc1e-fef6819871d6 req-e5416a96-ce8d-4132-809c-fc00e67658b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d7d294-5cc6-4500-9845-3ce118d36e6f", "tag": "3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:29:07.320753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:29:07.320753 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:29:07.327574 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-fd17e8f0-72d0-4e4a-bc1e-fef6819871d6 req-e5416a96-ce8d-4132-809c-fc00e67658b1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:07.328021 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-fd17e8f0-72d0-4e4a-bc1e-fef6819871d6 req-e5416a96-ce8d-4132-809c-fc00e67658b1 service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:07.339018 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-fd17e8f0-72d0-4e4a-bc1e-fef6819871d6 req-e5416a96-ce8d-4132-809c-fc00e67658b1 service nova] Creating event network-changed:3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e for instance 06d7d294-5cc6-4500-9845-3ce118d36e6f on hv-cinder-82481 Jan 15 16:29:07.344074 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-fd17e8f0-72d0-4e4a-bc1e-fef6819871d6 req-e5416a96-ce8d-4132-809c-fc00e67658b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089027 Jan 15 16:29:07.344737 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1014/2073] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:29:07.516278 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [f1b76d0c-1dfc-48f2-8efe-d0622797226f] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 16:29:08.265139 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] [14db0917-d513-4ff7-a257-d7f8104704fb] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44502. Jan 15 16:29:08.524257 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [f1b76d0c-1dfc-48f2-8efe-d0622797226f] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44504. Jan 15 16:29:08.598896 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-ea6cc960-882e-4c1f-b6fc-f7697cba0ec7 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 204 len: 0 microversion: 2.1 time: 1.346205 Jan 15 16:29:08.599481 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1060/2074] 10.222.0.36 () {58 vars in 1238 bytes} [Sat Jan 15 16:29:07 2022] DELETE /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 0 bytes in 1348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 16:29:08.609249 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:29:08.609946 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:29:08.617784 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:08.618809 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:08.619075 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:08.619519 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:08.622891 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] [43d2fcfd-d4cf-4a53-85c2-5c0d0fa7032d] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44508. Jan 15 16:29:08.754327 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:29:08.762000 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-af0e9312-2a46-4c40-b5cf-5a957c9ab6b2 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1450 microversion: 2.1 time: 0.157672 Jan 15 16:29:08.762561 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1015/2075] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:29:08 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:29:09.780404 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:29:09.781109 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:29:09.788666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:09.789119 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:09.789891 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:09.790328 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:09.924114 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:29:09.932214 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-6fa40395-5ac1-49fb-847a-1b82613a04f0 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1450 microversion: 2.1 time: 0.155850 Jan 15 16:29:09.932769 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1061/2076] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:29:09 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:29:10.738730 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [req-338600cb-4cc8-46b4-83c8-7bc670244c20 req-7f87e94d-1d0a-4278-a46c-09cd5295193f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d7d294-5cc6-4500-9845-3ce118d36e6f", "name": "network-vif-deleted", "tag": "3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e"}]} {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 16:29:10.740459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 16:29:10.740459 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: warnings.warn(msg) Jan 15 16:29:10.748038 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-338600cb-4cc8-46b4-83c8-7bc670244c20 req-7f87e94d-1d0a-4278-a46c-09cd5295193f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:10.754182 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [req-338600cb-4cc8-46b4-83c8-7bc670244c20 req-7f87e94d-1d0a-4278-a46c-09cd5295193f service nova] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:10.759890 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.compute.server_external_events [req-338600cb-4cc8-46b4-83c8-7bc670244c20 req-7f87e94d-1d0a-4278-a46c-09cd5295193f service nova] Creating event network-vif-deleted:3f7b72b5-61ac-4ea3-a384-32f0c09a7a1e for instance 06d7d294-5cc6-4500-9845-3ce118d36e6f on hv-cinder-82481 Jan 15 16:29:10.765173 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [req-338600cb-4cc8-46b4-83c8-7bc670244c20 req-7f87e94d-1d0a-4278-a46c-09cd5295193f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030539 Jan 15 16:29:10.765757 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1016/2077] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Jan 15 16:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 16:29:10.949555 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:29:10.950076 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:29:10.956209 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:10.956657 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:10.957428 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:10.957859 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:11.019885 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.policy [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123220) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:29:11.029666 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-e9cb3c6c-8db6-4239-82d9-0f65c9ccf867 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1219 microversion: 2.1 time: 0.083746 Jan 15 16:29:11.031549 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1062/2078] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:29:10 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:29:12.046301 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:29:12.046996 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.compute.api [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123221) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:29:12.053556 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:12.053994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:12.054782 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:12.055214 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:12.086509 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:12.086963 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG oslo_concurrency.lockutils [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:12.087417 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.objects.instance [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lazy-loading 'fault' on Instance uuid 06d7d294-5cc6-4500-9845-3ce118d36e6f {{(pid=123221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 16:29:12.129994 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.policy [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21745b7e41746f89af5e9130dbb8695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059ecd33a4c34286a4eff635782704bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123221) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 16:29:12.137475 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-c98db771-62e4-484b-8b03-d94dbdb328c1 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 200 len: 1178 microversion: 2.1 time: 0.095153 Jan 15 16:29:12.138045 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1017/2079] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:29:12 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 1178 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 16:29:13.154095 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '>' {{(pid=123220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:29:13.154714 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.compute.api [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] [instance: 06d7d294-5cc6-4500-9845-3ce118d36e6f] Fetching instance by UUID {{(pid=123220) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 16:29:13.161027 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:13.161480 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:13.162260 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 16:29:13.163361 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG oslo_concurrency.lockutils [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Lock "9f0284d2-cfc5-416a-8f7b-7c6b0565ac94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 16:29:13.176371 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.wsgi [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] HTTP exception thrown: Instance 06d7d294-5cc6-4500-9845-3ce118d36e6f could not be found. Jan 15 16:29:13.176987 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: DEBUG nova.api.openstack.wsgi [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Returning 404 to user: Instance 06d7d294-5cc6-4500-9845-3ce118d36e6f could not be found. {{(pid=123220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 16:29:13.177791 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO nova.api.openstack.requestlog [None req-806422b2-952a-43ef-ba5f-e806f3b31bc9 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f" status: 404 len: 111 microversion: 2.1 time: 0.027420 Jan 15 16:29:13.178318 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: [pid: 123220|app: 0|req: 1063/2080] 10.222.0.36 () {58 vars in 1235 bytes} [Sat Jan 15 16:29:13 2022] GET /compute/v2.1/servers/06d7d294-5cc6-4500-9845-3ce118d36e6f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 16:29:13.397773 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: DEBUG nova.api.openstack.wsgi [None req-b4a86fbd-32dc-415f-9298-46ce328c85e8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] Calling method '.version_select at 0x7f216813f820>' {{(pid=123221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 16:29:13.474983 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO nova.api.openstack.requestlog [None req-b4a86fbd-32dc-415f-9298-46ce328c85e8 tempest-TestShelveInstance-1038070402 tempest-TestShelveInstance-1038070402-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1871994652" status: 202 len: 0 microversion: 2.1 time: 0.081597 Jan 15 16:29:13.475607 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: [pid: 123221|app: 0|req: 1018/2081] 10.222.0.36 () {58 vars in 1253 bytes} [Sat Jan 15 16:29:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1871994652 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 16:30:54.359589 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:30:54.360166 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:33:17.726096 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:33:17.726694 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:33:24.339909 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:33:24.340616 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:33:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:33:32.020461 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:33:32.021056 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:33:33.881631 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:33:33.882471 dv-cinder-824819-1-iscsi devstack@n-api.service[123220]: Sat Jan 15 16:33:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 16:33:48.251924 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 16:33:48.252408 dv-cinder-824819-1-iscsi devstack@n-api.service[123221]: Sat Jan 15 16:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!